Aug 17 08:09:49 user nova-compute[72998]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 17 08:09:52 user nova-compute[72998]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72998) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 08:09:52 user nova-compute[72998]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72998) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 08:09:52 user nova-compute[72998]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72998) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 08:09:52 user nova-compute[72998]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 17 08:09:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:09:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:09:52 user nova-compute[72998]: INFO nova.virt.driver [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 17 08:09:53 user nova-compute[72998]: INFO nova.compute.provider_config [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] Acquiring lock "singleton_lock" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] Acquired lock "singleton_lock" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] Releasing lock "singleton_lock" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] Full set of CONF: {{(pid=72998) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ******************************************************************************** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] Configuration options gathered from: {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ================================================================================ {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] allow_resize_to_same_host      = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] arq_binding_timeout            = 300 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] backdoor_port                  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] backdoor_socket                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] block_device_allocate_retries  = 300 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] block_device_allocate_retries_interval = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cert                           = self.pem {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute_monitors               = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] config_dir                     = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] config_drive_format            = iso9660 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] config_source                  = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] console_host                   = user {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] control_exchange               = nova {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cpu_allocation_ratio           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] daemon                         = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] debug                          = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] default_access_ip_network_name = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] default_availability_zone      = nova {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] default_ephemeral_format       = ext4 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] default_schedule_zone          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] disk_allocation_ratio          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] enable_new_services            = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] enabled_ssl_apis               = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] flat_injected                  = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] force_config_drive             = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] force_raw_images               = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] graceful_shutdown_timeout      = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] heal_instance_info_cache_interval = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] host                           = user {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] instance_build_timeout         = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] instance_delete_interval       = 300 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] instance_name_template         = instance-%08x {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] instance_usage_audit           = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] instance_usage_audit_period    = month {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] internal_service_availability_zone = internal {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] key                            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] live_migration_retry_count     = 30 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] log_config_append              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] log_dir                        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] log_file                       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] log_options                    = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] log_rotate_interval            = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] log_rotate_interval_type       = days {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] log_rotation_type              = none {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] long_rpc_timeout               = 1800 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] max_concurrent_builds          = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] max_concurrent_live_migrations = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] max_concurrent_snapshots       = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] max_local_block_devices        = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] max_logfile_count              = 30 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] max_logfile_size_mb            = 200 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] maximum_instance_delete_attempts = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] metadata_listen                = 0.0.0.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] metadata_listen_port           = 8775 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] metadata_workers               = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] migrate_max_retries            = -1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] mkisofs_cmd                    = genisoimage {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] my_ip                          = 10.0.0.210 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] network_allocate_retries       = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] osapi_compute_listen_port      = 8774 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] osapi_compute_unique_server_name_scope =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] osapi_compute_workers          = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] password_length                = 12 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] periodic_enable                = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] periodic_fuzzy_delay           = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] pointer_model                  = ps2mouse {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] preallocate_images             = none {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] publish_errors                 = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] pybasedir                      = /opt/stack/nova {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ram_allocation_ratio           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] rate_limit_burst               = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] rate_limit_except_level        = CRITICAL {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] rate_limit_interval            = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] reboot_timeout                 = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] reclaim_instance_interval      = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] record                         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] reimage_timeout_per_gb         = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] report_interval                = 120 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] rescue_timeout                 = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] reserved_host_cpus             = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] reserved_host_disk_mb          = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] reserved_host_memory_mb        = 512 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] reserved_huge_pages            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] resize_confirm_window          = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] resize_fs_using_block_device   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] resume_guests_state_on_host_boot = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] rpc_response_timeout           = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] run_external_periodic_tasks    = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] running_deleted_instance_action = reap {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] running_deleted_instance_timeout = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler_instance_sync_interval = 120 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_down_time              = 720 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] servicegroup_driver            = db {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] shelved_offload_time           = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] shelved_poll_interval          = 3600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] shutdown_timeout               = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] source_is_ipv6                 = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ssl_only                       = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] state_path                     = /opt/stack/data/nova {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] sync_power_state_interval      = 600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] sync_power_state_pool_size     = 1000 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] syslog_log_facility            = LOG_USER {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] tempdir                        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] timeout_nbd                    = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] transport_url                  = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] update_resources_interval      = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] use_cow_images                 = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] use_eventlog                   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] use_journal                    = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] use_json                       = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] use_rootwrap_daemon            = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] use_stderr                     = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] use_syslog                     = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vcpu_pin_set                   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plugging_is_fatal          = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plugging_timeout           = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] virt_mkfs                      = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] volume_usage_poll_interval     = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] watch_log_file                 = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] web                            = /usr/share/spice-html5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_concurrency.disable_process_locking = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.auth_strategy              = keystone {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.compute_link_prefix        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.dhcp_domain                = novalocal {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.enable_instance_password   = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.glance_link_prefix         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.instance_list_per_project_cells = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.list_records_by_skipping_down_cells = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.local_metadata_per_cell    = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.max_limit                  = 1000 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.metadata_cache_expiration  = 15 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.neutron_default_tenant_id  = default {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.use_forwarded_for          = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.use_neutron_default_nets   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.vendordata_dynamic_targets = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.vendordata_jsonfile_path   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.backend_argument         = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.config_prefix            = cache.oslo {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.dead_timeout             = 60.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.debug_cache_backend      = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.enable_retry_client      = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.enable_socket_keepalive  = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.enabled                  = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.expiration_time          = 600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.hashclient_retry_attempts = 2 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_dead_retry      = 300 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_password        =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_sasl_enabled    = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.memcache_username        =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.proxies                  = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.retry_attempts           = 2 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.retry_delay              = 0.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.socket_keepalive_count   = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.socket_keepalive_idle    = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.socket_keepalive_interval = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.tls_allowed_ciphers      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.tls_cafile               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.tls_certfile             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.tls_enabled              = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cache.tls_keyfile              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.auth_section            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.auth_type               = password {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.cafile                  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.certfile                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.collect_timing          = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.cross_az_attach         = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.debug                   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.endpoint_template       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.http_retries            = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.insecure                = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.keyfile                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.os_region_name          = RegionOne {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.split_loggers           = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cinder.timeout                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.cpu_dedicated_set      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.cpu_shared_set         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.image_type_exclude_list = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.resource_provider_association_refresh = 300 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.shutdown_retry_interval = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] conductor.workers              = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] console.allowed_origins        = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] console.ssl_ciphers            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] console.ssl_minimum_version    = default {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] consoleauth.token_ttl          = 600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.cafile                  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.certfile                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.collect_timing          = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.connect_retries         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.connect_retry_delay     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.endpoint_override       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.insecure                = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.keyfile                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.max_version             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.min_version             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.region_name             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.service_name            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.service_type            = accelerator {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.split_loggers           = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.status_code_retries     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.status_code_retry_delay = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.timeout                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] cyborg.version                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.backend               = sqlalchemy {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.connection            = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.connection_debug      = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.connection_parameters =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.connection_recycle_time = 3600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.connection_trace      = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.db_inc_retry_interval = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.db_max_retries        = 20 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.db_max_retry_interval = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.db_retry_interval     = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.max_overflow          = 50 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.max_pool_size         = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.max_retries           = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.mysql_enable_ndb      = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.mysql_wsrep_sync_wait = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.pool_timeout          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.retry_interval        = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.slave_connection      = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] database.sqlite_synchronous    = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.backend           = sqlalchemy {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.connection        = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.connection_debug  = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.connection_parameters =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.connection_recycle_time = 3600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.connection_trace  = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.db_inc_retry_interval = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.db_max_retries    = 20 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.db_max_retry_interval = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.db_retry_interval = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.max_overflow      = 50 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.max_pool_size     = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.max_retries       = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.mysql_enable_ndb  = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.pool_timeout      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.retry_interval    = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.slave_connection  = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] api_database.sqlite_synchronous = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] devices.enabled_mdev_types     = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ephemeral_storage_encryption.enabled = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.api_servers             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.cafile                  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.certfile                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.collect_timing          = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.connect_retries         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.connect_retry_delay     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.debug                   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.default_trusted_certificate_ids = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.enable_certificate_validation = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.enable_rbd_download     = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.endpoint_override       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.insecure                = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.keyfile                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.max_version             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.min_version             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.num_retries             = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.rbd_ceph_conf           =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.rbd_connect_timeout     = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.rbd_pool                =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.rbd_user                =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.region_name             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.service_name            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.service_type            = image {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.split_loggers           = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.status_code_retries     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.status_code_retry_delay = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.timeout                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.verify_glance_signatures = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] glance.version                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] guestfs.debug                  = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.config_drive_cdrom      = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.config_drive_inject_password = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.enable_remotefx         = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.instances_path_share    =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.limit_cpu_features      = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.use_multipath_io        = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.vswitch_name            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] mks.enabled                    = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] image_cache.manager_interval   = 2400 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] image_cache.precache_concurrency = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] image_cache.remove_unused_base_images = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] image_cache.subdirectory_name  = _base {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.api_max_retries         = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.api_retry_interval      = 2 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.auth_section            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.auth_type               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.cafile                  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.certfile                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.collect_timing          = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.connect_retries         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.connect_retry_delay     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.endpoint_override       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.insecure                = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.keyfile                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.max_version             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.min_version             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.partition_key           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.peer_list               = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.region_name             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.serial_console_state_timeout = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.service_name            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.service_type            = baremetal {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.split_loggers           = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.status_code_retries     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.status_code_retry_delay = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.timeout                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ironic.version                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] key_manager.fixed_key          = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.barbican_api_version  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.barbican_endpoint     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.barbican_endpoint_type = public {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.barbican_region_name  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.cafile                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.certfile              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.collect_timing        = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.insecure              = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.keyfile               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.number_of_retries     = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.retry_delay           = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.send_service_user_token = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.split_loggers         = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.timeout               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.verify_ssl            = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican.verify_ssl_path       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican_service_user.auth_section = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican_service_user.auth_type = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican_service_user.cafile   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican_service_user.certfile = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican_service_user.collect_timing = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican_service_user.insecure = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican_service_user.keyfile  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican_service_user.split_loggers = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] barbican_service_user.timeout  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.approle_role_id          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.approle_secret_id        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.cafile                   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.certfile                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.collect_timing           = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.insecure                 = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.keyfile                  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.kv_mountpoint            = secret {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.kv_version               = 2 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.namespace                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.root_token_id            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.split_loggers            = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.ssl_ca_crt_file          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.timeout                  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.use_ssl                  = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.cafile                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.certfile              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.collect_timing        = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.connect_retries       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.connect_retry_delay   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.endpoint_override     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.insecure              = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.keyfile               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.max_version           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.min_version           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.region_name           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.service_name          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.service_type          = identity {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.split_loggers         = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.status_code_retries   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.status_code_retry_delay = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.timeout               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] keystone.version               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.connection_uri         =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.cpu_mode               = custom {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: WARNING oslo_config.cfg [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.cpu_power_governor_high = performance {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.cpu_power_management   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.device_detach_attempts = 8 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.device_detach_timeout  = 20 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.disk_cachemodes        = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.disk_prefix            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.enabled_perf_events    = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.file_backed_memory     = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.gid_maps               = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.hw_disk_discard        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.hw_machine_type        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.images_rbd_pool        = rbd {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.images_type            = default {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.images_volume_group    = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.inject_key             = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.inject_partition       = -2 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.inject_password        = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.iscsi_iface            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.iser_use_multipath     = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_downtime = 500 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_inbound_addr = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_scheme  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_timeout_action = abort {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_tunnelled = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: WARNING oslo_config.cfg [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 17 08:09:53 user nova-compute[72998]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 17 08:09:53 user nova-compute[72998]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 17 08:09:53 user nova-compute[72998]: and ``live_migration_inbound_addr`` respectively.
Aug 17 08:09:53 user nova-compute[72998]: ).  Its value may be silently ignored in the future.
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.live_migration_with_native_tls = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.max_queues             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.nfs_mount_options      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.num_pcie_ports         = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.pmem_namespaces        = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.quobyte_client_cfg     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rbd_secret_uuid        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rbd_user               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rescue_image_id        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rescue_kernel_id       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.rx_queue_size          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.smbfs_mount_options    =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.snapshot_compression   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.snapshot_image_format  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.sparse_logical_volumes = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.swtpm_enabled          = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.swtpm_group            = tss {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.swtpm_user             = tss {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.sysinfo_serial         = unique {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.tb_cache_size          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.tx_queue_size          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.uid_maps               = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.use_virtio_for_bridges = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.virt_type              = kvm {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.volume_clear           = zero {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.volume_clear_size      = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.volume_use_multipath   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.vzstorage_cache_path   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.auth_section           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.auth_type              = password {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.cafile                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.certfile               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.collect_timing         = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.connect_retries        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.connect_retry_delay    = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.default_floating_pool  = public {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.endpoint_override      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.extension_sync_interval = 600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.http_retries           = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.insecure               = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.keyfile                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.max_version            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.min_version            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.ovs_bridge             = br-int {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.physnets               = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.region_name            = RegionOne {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.service_metadata_proxy = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.service_name           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.service_type           = network {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.split_loggers          = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.status_code_retries    = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.status_code_retry_delay = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.timeout                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] neutron.version                = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] notifications.bdms_in_notifications = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] notifications.default_level    = INFO {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] notifications.notification_format = unversioned {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] notifications.notify_on_state_change = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] pci.alias                      = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] pci.device_spec                = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] pci.report_in_placement        = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.auth_section         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.auth_type            = password {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.cafile               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.certfile             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.collect_timing       = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.connect_retries      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.connect_retry_delay  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.default_domain_id    = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.default_domain_name  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.domain_id            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.domain_name          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.endpoint_override    = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.insecure             = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.keyfile              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.max_version          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.min_version          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.password             = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.project_domain_id    = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.project_domain_name  = Default {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.project_id           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.project_name         = service {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.region_name          = RegionOne {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.service_name         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.service_type         = placement {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.split_loggers        = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.status_code_retries  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.status_code_retry_delay = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.system_scope         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.timeout              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.trust_id             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.user_domain_id       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.user_domain_name     = Default {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.user_id              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.username             = placement {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] placement.version              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.cores                    = 20 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.count_usage_from_placement = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.injected_file_content_bytes = 10240 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.injected_file_path_length = 255 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.injected_files           = 5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.instances                = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.key_pairs                = 100 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.metadata_items           = 128 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.ram                      = 51200 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.recheck_quota            = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.server_group_members     = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] quota.server_groups            = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] rdp.enabled                    = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.image_metadata_prefilter = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.max_attempts         = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.max_placement_results = 1000 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] scheduler.workers              = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.host_subset_size = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.isolated_hosts = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.isolated_images = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.pci_in_placement = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.track_instance_changes = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] metrics.required               = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] metrics.weight_multiplier      = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] metrics.weight_setting         = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] serial_console.enabled         = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] serial_console.port_range      = 10000:20000 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] serial_console.serialproxy_port = 6083 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.auth_section      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.auth_type         = password {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.cafile            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.certfile          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.collect_timing    = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.insecure          = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.keyfile           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.send_service_user_token = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.split_loggers     = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] service_user.timeout           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.agent_enabled            = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.enabled                  = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.html5proxy_port          = 6082 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.image_compression        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.jpeg_compression         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.playback_compression     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.server_listen            = 127.0.0.1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.streaming_mode           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] spice.zlib_compression         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] upgrade_levels.baseapi         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] upgrade_levels.cert            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] upgrade_levels.compute         = auto {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] upgrade_levels.conductor       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] upgrade_levels.scheduler       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vendordata_dynamic_auth.cafile = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vendordata_dynamic_auth.certfile = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vendordata_dynamic_auth.insecure = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vendordata_dynamic_auth.timeout = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.api_retry_count         = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.ca_file                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.cache_prefix            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.cluster_name            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.connection_pool_size    = 10 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.console_delay_seconds   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.datastore_regex         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.host_ip                 = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.host_password           = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.host_port               = 443 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.host_username           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.insecure                = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.integration_bridge      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.maximum_objects         = 100 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.pbm_default_policy      = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.pbm_enabled             = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.pbm_wsdl_location       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.serial_port_proxy_uri   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.serial_port_service_uri = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.task_poll_interval      = 0.5 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.use_linked_clone        = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.vnc_keymap              = en-us {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.vnc_port                = 5900 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vmware.vnc_port_total          = 10000 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.auth_schemes               = ['none'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.enabled                    = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.novncproxy_port            = 6080 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.vencrypt_ca_certs          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.vencrypt_client_cert       = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vnc.vencrypt_client_key        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.disable_rootwrap   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.enable_numa_live_migration = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.libvirt_disable_apic = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.client_socket_timeout     = 900 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.default_pool_size         = 1000 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.keep_alive                = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.max_header_line           = 16384 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.ssl_ca_file               = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.ssl_cert_file             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.ssl_key_file              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.tcp_keepidle              = 600 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] zvm.ca_file                    = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] zvm.cloud_connector_url        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] zvm.reachable_timeout          = 300 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.enforce_new_defaults = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.enforce_scope      = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.policy_default_rule = default {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.connection_string     = messaging:// {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.enabled               = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.es_doc_type           = notification {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.es_scroll_size        = 10000 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.es_scroll_time        = 2m {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.filter_error_trace    = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.hmac_keys             = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.sentinel_service_name = mymaster {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.socket_timeout        = 0.1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.trace_requests        = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler.trace_sqlalchemy      = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler_jaeger.process_tags   = {} {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler_jaeger.service_name_prefix = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] profiler_otlp.service_name_prefix = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] remote_debug.host              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] remote_debug.port              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_notifications.retry = -1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.auth_section        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.auth_type           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.cafile              = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.certfile            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.collect_timing      = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.connect_retries     = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.connect_retry_delay = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.endpoint_id         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.endpoint_override   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.insecure            = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.keyfile             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.max_version         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.min_version         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.region_name         = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.service_name        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.service_type        = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.split_loggers       = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.status_code_retries = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.status_code_retry_delay = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.timeout             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.valid_interfaces    = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_limit.version             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_reports.file_event_handler = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] oslo_reports.log_dir           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_ovs_privileged.group  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] vif_plug_ovs_privileged.user   = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_ovs.isolate_vif         = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] os_brick.lock_path             = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] privsep_osbrick.capabilities   = [21] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] privsep_osbrick.group          = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] privsep_osbrick.helper_command = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] privsep_osbrick.user           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] nova_sys_admin.group           = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] nova_sys_admin.helper_command  = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] nova_sys_admin.user            = None {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG oslo_service.service [None req-29bdac8b-5d54-4ba3-a270-bafe1a9a75c6 None None] ******************************************************************************** {{(pid=72998) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 17 08:09:53 user nova-compute[72998]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 17 08:09:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Starting native event thread {{(pid=72998) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Starting green dispatch thread {{(pid=72998) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Starting connection event dispatch thread {{(pid=72998) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Connecting to libvirt: qemu:///system {{(pid=72998) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa4ac518ee0> {{(pid=72998) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 17 08:09:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa4ac518ee0> {{(pid=72998) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 17 08:09:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Connection event '1' reason 'None'
Aug 17 08:09:53 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 08:09:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.mount [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Initialising _HostMountState generation 0 {{(pid=72998) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 17 08:10:00 user nova-compute[72998]: INFO nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt host capabilities <capabilities>
Aug 17 08:10:00 user nova-compute[72998]:   <host>
Aug 17 08:10:00 user nova-compute[72998]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 17 08:10:00 user nova-compute[72998]:     <cpu>
Aug 17 08:10:00 user nova-compute[72998]:       <arch>x86_64</arch>
Aug 17 08:10:00 user nova-compute[72998]:       <model>IvyBridge-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <vendor>Intel</vendor>
Aug 17 08:10:00 user nova-compute[72998]:       <microcode version='1070'/>
Aug 17 08:10:00 user nova-compute[72998]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 17 08:10:00 user nova-compute[72998]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='ss'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='vmx'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='pcid'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='osxsave'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='hypervisor'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='arat'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='tsc_adjust'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='md-clear'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='stibp'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='arch-capabilities'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='ssbd'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='invtsc'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='rsba'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature name='skip-l1dfl-vmentry'/>
Aug 17 08:10:00 user nova-compute[72998]:       <pages unit='KiB' size='4'/>
Aug 17 08:10:00 user nova-compute[72998]:       <pages unit='KiB' size='2048'/>
Aug 17 08:10:00 user nova-compute[72998]:     </cpu>
Aug 17 08:10:00 user nova-compute[72998]:     <power_management>
Aug 17 08:10:00 user nova-compute[72998]:       <suspend_mem/>
Aug 17 08:10:00 user nova-compute[72998]:       <suspend_disk/>
Aug 17 08:10:00 user nova-compute[72998]:       <suspend_hybrid/>
Aug 17 08:10:00 user nova-compute[72998]:     </power_management>
Aug 17 08:10:00 user nova-compute[72998]:     <iommu support='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     <migration_features>
Aug 17 08:10:00 user nova-compute[72998]:       <live/>
Aug 17 08:10:00 user nova-compute[72998]:       <uri_transports>
Aug 17 08:10:00 user nova-compute[72998]:         <uri_transport>tcp</uri_transport>
Aug 17 08:10:00 user nova-compute[72998]:         <uri_transport>rdma</uri_transport>
Aug 17 08:10:00 user nova-compute[72998]:       </uri_transports>
Aug 17 08:10:00 user nova-compute[72998]:     </migration_features>
Aug 17 08:10:00 user nova-compute[72998]:     <topology>
Aug 17 08:10:00 user nova-compute[72998]:       <cells num='2'>
Aug 17 08:10:00 user nova-compute[72998]:         <cell id='0'>
Aug 17 08:10:00 user nova-compute[72998]:           <memory unit='KiB'>8140616</memory>
Aug 17 08:10:00 user nova-compute[72998]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 17 08:10:00 user nova-compute[72998]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 08:10:00 user nova-compute[72998]:           <distances>
Aug 17 08:10:00 user nova-compute[72998]:             <sibling id='0' value='10'/>
Aug 17 08:10:00 user nova-compute[72998]:             <sibling id='1' value='20'/>
Aug 17 08:10:00 user nova-compute[72998]:           </distances>
Aug 17 08:10:00 user nova-compute[72998]:           <cpus num='6'>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 17 08:10:00 user nova-compute[72998]:           </cpus>
Aug 17 08:10:00 user nova-compute[72998]:         </cell>
Aug 17 08:10:00 user nova-compute[72998]:         <cell id='1'>
Aug 17 08:10:00 user nova-compute[72998]:           <memory unit='KiB'>8255068</memory>
Aug 17 08:10:00 user nova-compute[72998]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 17 08:10:00 user nova-compute[72998]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 08:10:00 user nova-compute[72998]:           <distances>
Aug 17 08:10:00 user nova-compute[72998]:             <sibling id='0' value='20'/>
Aug 17 08:10:00 user nova-compute[72998]:             <sibling id='1' value='10'/>
Aug 17 08:10:00 user nova-compute[72998]:           </distances>
Aug 17 08:10:00 user nova-compute[72998]:           <cpus num='6'>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 17 08:10:00 user nova-compute[72998]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 17 08:10:00 user nova-compute[72998]:           </cpus>
Aug 17 08:10:00 user nova-compute[72998]:         </cell>
Aug 17 08:10:00 user nova-compute[72998]:       </cells>
Aug 17 08:10:00 user nova-compute[72998]:     </topology>
Aug 17 08:10:00 user nova-compute[72998]:     <cache>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 17 08:10:00 user nova-compute[72998]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 17 08:10:00 user nova-compute[72998]:     </cache>
Aug 17 08:10:00 user nova-compute[72998]:     <secmodel>
Aug 17 08:10:00 user nova-compute[72998]:       <model>apparmor</model>
Aug 17 08:10:00 user nova-compute[72998]:       <doi>0</doi>
Aug 17 08:10:00 user nova-compute[72998]:     </secmodel>
Aug 17 08:10:00 user nova-compute[72998]:     <secmodel>
Aug 17 08:10:00 user nova-compute[72998]:       <model>dac</model>
Aug 17 08:10:00 user nova-compute[72998]:       <doi>0</doi>
Aug 17 08:10:00 user nova-compute[72998]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 17 08:10:00 user nova-compute[72998]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 17 08:10:00 user nova-compute[72998]:     </secmodel>
Aug 17 08:10:00 user nova-compute[72998]:   </host>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='alpha'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>clipper</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='armv6l'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>spitz</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>nuri</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>kzm</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sx1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>z2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>tosa</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>n810</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>n800</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>terrier</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>midway</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>microbit</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>verdex</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>highbank</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>akita</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>connex</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>collie</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='armv7l'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>spitz</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>nuri</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>kzm</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sx1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>z2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>tosa</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>n810</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>n800</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>terrier</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>midway</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>microbit</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>verdex</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>highbank</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>akita</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>connex</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>collie</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='aarch64'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>spitz</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>nuri</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>kzm</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sx1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>z2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>tosa</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>n810</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>n800</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>terrier</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>midway</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>microbit</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>verdex</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>raspi3b</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>highbank</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>akita</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>connex</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>collie</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <acpi default='on' toggle='yes'/>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='cris'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='i686'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>isapc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>microvm</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='kvm'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <pae/>
Aug 17 08:10:00 user nova-compute[72998]:       <nonpae/>
Aug 17 08:10:00 user nova-compute[72998]:       <acpi default='on' toggle='yes'/>
Aug 17 08:10:00 user nova-compute[72998]:       <apic default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='m68k'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>an5206</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>q800</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>next-cube</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='microblaze'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='microblazeel'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='mips'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='16'>malta</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='mipsel'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='16'>malta</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='mips64'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='16'>malta</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>pica61</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>magnum</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='mips64el'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='16'>malta</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>pica61</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>magnum</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='16'>boston</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='ppc'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mac99</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>40p</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>taihu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='ppc64'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>taihu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>40p</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mac99</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='ppc64le'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>taihu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>40p</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>mac99</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='riscv32'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='8'>spike</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>opentitan</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='8'>virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='riscv64'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='8'>spike</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>shakti_c</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='8'>virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='s390x'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='sh4'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>shix</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>r2d</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='sh4eb'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>shix</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>r2d</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='sparc'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>SS-5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>SS-20</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>LX</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>SS-4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>SS-10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>Voyager</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='sparc64'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sun4u</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>niagara</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>sun4v</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='x86_64'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>64</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='1'>isapc</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>microvm</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='kvm'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <acpi default='on' toggle='yes'/>
Aug 17 08:10:00 user nova-compute[72998]:       <apic default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='xtensa'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>sim</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>kc705</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>ml605</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>lx200</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>lx60</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]:   <guest>
Aug 17 08:10:00 user nova-compute[72998]:     <os_type>hvm</os_type>
Aug 17 08:10:00 user nova-compute[72998]:     <arch name='xtensaeb'>
Aug 17 08:10:00 user nova-compute[72998]:       <wordsize>32</wordsize>
Aug 17 08:10:00 user nova-compute[72998]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='4'>sim</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>kc705</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>ml605</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>virt</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>lx200</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>lx60</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 08:10:00 user nova-compute[72998]:       <domain type='qemu'/>
Aug 17 08:10:00 user nova-compute[72998]:     </arch>
Aug 17 08:10:00 user nova-compute[72998]:     <features>
Aug 17 08:10:00 user nova-compute[72998]:       <cpuselection/>
Aug 17 08:10:00 user nova-compute[72998]:       <deviceboot/>
Aug 17 08:10:00 user nova-compute[72998]:       <disksnapshot default='on' toggle='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     </features>
Aug 17 08:10:00 user nova-compute[72998]:   </guest>
Aug 17 08:10:00 user nova-compute[72998]: </capabilities>
Aug 17 08:10:00 user nova-compute[72998]: 
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 17 08:10:00 user nova-compute[72998]: <domainCapabilities>
Aug 17 08:10:00 user nova-compute[72998]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 08:10:00 user nova-compute[72998]:   <domain>kvm</domain>
Aug 17 08:10:00 user nova-compute[72998]:   <machine>pc-i440fx-jammy</machine>
Aug 17 08:10:00 user nova-compute[72998]:   <arch>i686</arch>
Aug 17 08:10:00 user nova-compute[72998]:   <vcpu max='255'/>
Aug 17 08:10:00 user nova-compute[72998]:   <iothreads supported='yes'/>
Aug 17 08:10:00 user nova-compute[72998]:   <os supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:     <enum name='firmware'/>
Aug 17 08:10:00 user nova-compute[72998]:     <loader supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>rom</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>pflash</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='readonly'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='secure'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </loader>
Aug 17 08:10:00 user nova-compute[72998]:   </os>
Aug 17 08:10:00 user nova-compute[72998]:   <cpu>
Aug 17 08:10:00 user nova-compute[72998]:     <mode name='host-passthrough' supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='hostPassthroughMigratable'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </mode>
Aug 17 08:10:00 user nova-compute[72998]:     <mode name='maximum' supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='maximumMigratable'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </mode>
Aug 17 08:10:00 user nova-compute[72998]:     <mode name='host-model' supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <vendor>Intel</vendor>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='ss'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='vmx'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='pcid'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='hypervisor'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='arat'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='umip'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='md-clear'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='stibp'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='ssbd'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='ibpb'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='ibrs'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='amd-stibp'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='disable' name='erms'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='disable' name='lm'/>
Aug 17 08:10:00 user nova-compute[72998]:     </mode>
Aug 17 08:10:00 user nova-compute[72998]:     <mode name='custom' supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>qemu64</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>qemu32</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>phenom</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>pentium3</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>pentium2</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>pentium</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>n270</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>kvm64</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>kvm32</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>coreduo</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>core2duo</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>athlon</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Westmere</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Snowridge</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Server</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Client</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>SandyBridge</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Penryn</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G5</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G4</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G3</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G2</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G1</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Nehalem</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>IvyBridge</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Icelake-Server</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Haswell</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>EPYC-Rome</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>EPYC-Milan</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>EPYC</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Dhyana</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Cooperlake</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Conroe</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Broadwell</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>486</model>
Aug 17 08:10:00 user nova-compute[72998]:     </mode>
Aug 17 08:10:00 user nova-compute[72998]:   </cpu>
Aug 17 08:10:00 user nova-compute[72998]:   <memoryBacking supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:     <enum name='sourceType'>
Aug 17 08:10:00 user nova-compute[72998]:       <value>file</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>anonymous</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>memfd</value>
Aug 17 08:10:00 user nova-compute[72998]:     </enum>
Aug 17 08:10:00 user nova-compute[72998]:   </memoryBacking>
Aug 17 08:10:00 user nova-compute[72998]:   <devices>
Aug 17 08:10:00 user nova-compute[72998]:     <disk supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='diskDevice'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>disk</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>cdrom</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>floppy</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>lun</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='bus'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>ide</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>fdc</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>sata</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </disk>
Aug 17 08:10:00 user nova-compute[72998]:     <graphics supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>sdl</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>vnc</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>spice</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>egl-headless</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </graphics>
Aug 17 08:10:00 user nova-compute[72998]:     <video supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='modelType'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>vga</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>cirrus</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>vmvga</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>qxl</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>none</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>bochs</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>ramfb</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </video>
Aug 17 08:10:00 user nova-compute[72998]:     <hostdev supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='mode'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>subsystem</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='startupPolicy'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>default</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>mandatory</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>requisite</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>optional</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='subsysType'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>pci</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='capsType'/>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='pciBackend'/>
Aug 17 08:10:00 user nova-compute[72998]:     </hostdev>
Aug 17 08:10:00 user nova-compute[72998]:     <rng supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>random</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>egd</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>builtin</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </rng>
Aug 17 08:10:00 user nova-compute[72998]:     <filesystem supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='driverType'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>path</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>handle</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>virtiofs</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </filesystem>
Aug 17 08:10:00 user nova-compute[72998]:     <tpm supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>tpm-tis</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>tpm-crb</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>passthrough</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>emulator</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </tpm>
Aug 17 08:10:00 user nova-compute[72998]:   </devices>
Aug 17 08:10:00 user nova-compute[72998]:   <features>
Aug 17 08:10:00 user nova-compute[72998]:     <gic supported='no'/>
Aug 17 08:10:00 user nova-compute[72998]:     <vmcoreinfo supported='yes'/>
Aug 17 08:10:00 user nova-compute[72998]:     <genid supported='yes'/>
Aug 17 08:10:00 user nova-compute[72998]:     <backingStoreInput supported='yes'/>
Aug 17 08:10:00 user nova-compute[72998]:     <backup supported='yes'/>
Aug 17 08:10:00 user nova-compute[72998]:     <sev supported='no'/>
Aug 17 08:10:00 user nova-compute[72998]:   </features>
Aug 17 08:10:00 user nova-compute[72998]: </domainCapabilities>
Aug 17 08:10:00 user nova-compute[72998]:  {{(pid=72998) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 08:10:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 17 08:10:00 user nova-compute[72998]: <domainCapabilities>
Aug 17 08:10:00 user nova-compute[72998]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 08:10:00 user nova-compute[72998]:   <domain>kvm</domain>
Aug 17 08:10:00 user nova-compute[72998]:   <machine>pc-q35-jammy</machine>
Aug 17 08:10:00 user nova-compute[72998]:   <arch>i686</arch>
Aug 17 08:10:00 user nova-compute[72998]:   <vcpu max='288'/>
Aug 17 08:10:00 user nova-compute[72998]:   <iothreads supported='yes'/>
Aug 17 08:10:00 user nova-compute[72998]:   <os supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:     <enum name='firmware'/>
Aug 17 08:10:00 user nova-compute[72998]:     <loader supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>rom</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>pflash</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='readonly'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='secure'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </loader>
Aug 17 08:10:00 user nova-compute[72998]:   </os>
Aug 17 08:10:00 user nova-compute[72998]:   <cpu>
Aug 17 08:10:00 user nova-compute[72998]:     <mode name='host-passthrough' supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='hostPassthroughMigratable'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </mode>
Aug 17 08:10:00 user nova-compute[72998]:     <mode name='maximum' supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <enum name='maximumMigratable'>
Aug 17 08:10:00 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:00 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:00 user nova-compute[72998]:       </enum>
Aug 17 08:10:00 user nova-compute[72998]:     </mode>
Aug 17 08:10:00 user nova-compute[72998]:     <mode name='host-model' supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <vendor>Intel</vendor>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='ss'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='vmx'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='pcid'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='hypervisor'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='arat'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='umip'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='md-clear'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='stibp'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='ssbd'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='ibpb'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='ibrs'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='amd-stibp'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='disable' name='erms'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 08:10:00 user nova-compute[72998]:       <feature policy='disable' name='lm'/>
Aug 17 08:10:00 user nova-compute[72998]:     </mode>
Aug 17 08:10:00 user nova-compute[72998]:     <mode name='custom' supported='yes'>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>qemu64</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>qemu32</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>phenom</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>pentium3</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>pentium2</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>pentium</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>n270</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>kvm64</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>kvm32</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='yes'>coreduo</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>core2duo</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>athlon</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Westmere</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Snowridge</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Server</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Skylake-Client</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>SandyBridge</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Penryn</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G5</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G4</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G3</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G2</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Opteron_G1</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Nehalem</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>IvyBridge</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no'>Icelake-Server</model>
Aug 17 08:10:00 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Rome</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Milan</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Dhyana</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cooperlake</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Conroe</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>486</model>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:   </cpu>
Aug 17 08:10:01 user nova-compute[72998]:   <memoryBacking supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='sourceType'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>file</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>anonymous</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>memfd</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:   </memoryBacking>
Aug 17 08:10:01 user nova-compute[72998]:   <devices>
Aug 17 08:10:01 user nova-compute[72998]:     <disk supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='diskDevice'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>disk</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cdrom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>floppy</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>lun</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='bus'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>fdc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sata</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </disk>
Aug 17 08:10:01 user nova-compute[72998]:     <graphics supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sdl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vnc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>spice</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egl-headless</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </graphics>
Aug 17 08:10:01 user nova-compute[72998]:     <video supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='modelType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cirrus</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vmvga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>qxl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>none</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>bochs</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ramfb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </video>
Aug 17 08:10:01 user nova-compute[72998]:     <hostdev supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='mode'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>subsystem</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='startupPolicy'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>default</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>mandatory</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>requisite</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>optional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='subsysType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pci</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='capsType'/>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='pciBackend'/>
Aug 17 08:10:01 user nova-compute[72998]:     </hostdev>
Aug 17 08:10:01 user nova-compute[72998]:     <rng supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>random</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egd</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>builtin</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </rng>
Aug 17 08:10:01 user nova-compute[72998]:     <filesystem supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='driverType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>path</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>handle</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtiofs</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </filesystem>
Aug 17 08:10:01 user nova-compute[72998]:     <tpm supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-tis</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-crb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>passthrough</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>emulator</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </tpm>
Aug 17 08:10:01 user nova-compute[72998]:   </devices>
Aug 17 08:10:01 user nova-compute[72998]:   <features>
Aug 17 08:10:01 user nova-compute[72998]:     <gic supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:     <vmcoreinfo supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <genid supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backingStoreInput supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backup supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <sev supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:   </features>
Aug 17 08:10:01 user nova-compute[72998]: </domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:  {{(pid=72998) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 17 08:10:01 user nova-compute[72998]: <domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 08:10:01 user nova-compute[72998]:   <domain>kvm</domain>
Aug 17 08:10:01 user nova-compute[72998]:   <machine>pc-i440fx-6.2</machine>
Aug 17 08:10:01 user nova-compute[72998]:   <arch>i686</arch>
Aug 17 08:10:01 user nova-compute[72998]:   <vcpu max='255'/>
Aug 17 08:10:01 user nova-compute[72998]:   <iothreads supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:   <os supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='firmware'/>
Aug 17 08:10:01 user nova-compute[72998]:     <loader supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>rom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pflash</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='readonly'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='secure'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </loader>
Aug 17 08:10:01 user nova-compute[72998]:   </os>
Aug 17 08:10:01 user nova-compute[72998]:   <cpu>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-passthrough' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='hostPassthroughMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='maximum' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='maximumMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-model' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <vendor>Intel</vendor>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ss'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='vmx'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pcid'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='hypervisor'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arat'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='umip'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='md-clear'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibpb'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibrs'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='erms'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='lm'/>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='custom' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>qemu64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>qemu32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>phenom</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>n270</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>kvm64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>coreduo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>core2duo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>athlon</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Westmere</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Snowridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Penryn</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G5</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G4</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G1</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Nehalem</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Rome</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Milan</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Dhyana</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cooperlake</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Conroe</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>486</model>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:   </cpu>
Aug 17 08:10:01 user nova-compute[72998]:   <memoryBacking supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='sourceType'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>file</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>anonymous</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>memfd</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:   </memoryBacking>
Aug 17 08:10:01 user nova-compute[72998]:   <devices>
Aug 17 08:10:01 user nova-compute[72998]:     <disk supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='diskDevice'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>disk</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cdrom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>floppy</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>lun</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='bus'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ide</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>fdc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sata</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </disk>
Aug 17 08:10:01 user nova-compute[72998]:     <graphics supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sdl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vnc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>spice</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egl-headless</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </graphics>
Aug 17 08:10:01 user nova-compute[72998]:     <video supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='modelType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cirrus</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vmvga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>qxl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>none</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>bochs</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ramfb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </video>
Aug 17 08:10:01 user nova-compute[72998]:     <hostdev supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='mode'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>subsystem</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='startupPolicy'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>default</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>mandatory</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>requisite</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>optional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='subsysType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pci</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='capsType'/>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='pciBackend'/>
Aug 17 08:10:01 user nova-compute[72998]:     </hostdev>
Aug 17 08:10:01 user nova-compute[72998]:     <rng supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>random</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egd</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>builtin</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </rng>
Aug 17 08:10:01 user nova-compute[72998]:     <filesystem supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='driverType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>path</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>handle</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtiofs</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </filesystem>
Aug 17 08:10:01 user nova-compute[72998]:     <tpm supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-tis</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-crb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>passthrough</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>emulator</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </tpm>
Aug 17 08:10:01 user nova-compute[72998]:   </devices>
Aug 17 08:10:01 user nova-compute[72998]:   <features>
Aug 17 08:10:01 user nova-compute[72998]:     <gic supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:     <vmcoreinfo supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <genid supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backingStoreInput supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backup supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <sev supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:   </features>
Aug 17 08:10:01 user nova-compute[72998]: </domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:  {{(pid=72998) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 17 08:10:01 user nova-compute[72998]: <domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 08:10:01 user nova-compute[72998]:   <domain>kvm</domain>
Aug 17 08:10:01 user nova-compute[72998]:   <machine>pc-q35-6.2</machine>
Aug 17 08:10:01 user nova-compute[72998]:   <arch>i686</arch>
Aug 17 08:10:01 user nova-compute[72998]:   <vcpu max='288'/>
Aug 17 08:10:01 user nova-compute[72998]:   <iothreads supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:   <os supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='firmware'/>
Aug 17 08:10:01 user nova-compute[72998]:     <loader supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>rom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pflash</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='readonly'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='secure'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </loader>
Aug 17 08:10:01 user nova-compute[72998]:   </os>
Aug 17 08:10:01 user nova-compute[72998]:   <cpu>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-passthrough' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='hostPassthroughMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='maximum' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='maximumMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-model' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <vendor>Intel</vendor>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ss'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='vmx'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pcid'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='hypervisor'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arat'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='umip'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='md-clear'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibpb'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibrs'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='erms'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='lm'/>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='custom' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>qemu64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>qemu32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>phenom</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>n270</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>kvm64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>coreduo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>core2duo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>athlon</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Westmere</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Snowridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Penryn</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G5</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G4</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G1</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Nehalem</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Rome</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Milan</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Dhyana</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cooperlake</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Conroe</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>486</model>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:   </cpu>
Aug 17 08:10:01 user nova-compute[72998]:   <memoryBacking supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='sourceType'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>file</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>anonymous</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>memfd</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:   </memoryBacking>
Aug 17 08:10:01 user nova-compute[72998]:   <devices>
Aug 17 08:10:01 user nova-compute[72998]:     <disk supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='diskDevice'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>disk</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cdrom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>floppy</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>lun</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='bus'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>fdc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sata</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </disk>
Aug 17 08:10:01 user nova-compute[72998]:     <graphics supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sdl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vnc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>spice</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egl-headless</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </graphics>
Aug 17 08:10:01 user nova-compute[72998]:     <video supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='modelType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cirrus</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vmvga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>qxl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>none</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>bochs</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ramfb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </video>
Aug 17 08:10:01 user nova-compute[72998]:     <hostdev supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='mode'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>subsystem</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='startupPolicy'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>default</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>mandatory</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>requisite</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>optional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='subsysType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pci</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='capsType'/>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='pciBackend'/>
Aug 17 08:10:01 user nova-compute[72998]:     </hostdev>
Aug 17 08:10:01 user nova-compute[72998]:     <rng supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>random</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egd</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>builtin</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </rng>
Aug 17 08:10:01 user nova-compute[72998]:     <filesystem supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='driverType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>path</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>handle</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtiofs</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </filesystem>
Aug 17 08:10:01 user nova-compute[72998]:     <tpm supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-tis</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-crb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>passthrough</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>emulator</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </tpm>
Aug 17 08:10:01 user nova-compute[72998]:   </devices>
Aug 17 08:10:01 user nova-compute[72998]:   <features>
Aug 17 08:10:01 user nova-compute[72998]:     <gic supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:     <vmcoreinfo supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <genid supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backingStoreInput supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backup supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <sev supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:   </features>
Aug 17 08:10:01 user nova-compute[72998]: </domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:  {{(pid=72998) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 17 08:10:01 user nova-compute[72998]: <domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 08:10:01 user nova-compute[72998]:   <domain>kvm</domain>
Aug 17 08:10:01 user nova-compute[72998]:   <machine>pc-i440fx-jammy</machine>
Aug 17 08:10:01 user nova-compute[72998]:   <arch>x86_64</arch>
Aug 17 08:10:01 user nova-compute[72998]:   <vcpu max='255'/>
Aug 17 08:10:01 user nova-compute[72998]:   <iothreads supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:   <os supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='firmware'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>efi</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:     <loader supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>rom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pflash</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='readonly'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='secure'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </loader>
Aug 17 08:10:01 user nova-compute[72998]:   </os>
Aug 17 08:10:01 user nova-compute[72998]:   <cpu>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-passthrough' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='hostPassthroughMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='maximum' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='maximumMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-model' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <vendor>Intel</vendor>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ss'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='vmx'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pcid'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='hypervisor'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arat'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='umip'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='md-clear'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='invtsc'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibpb'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibrs'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='rsba'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='erms'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='custom' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>qemu64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>qemu32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>phenom</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>n270</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>coreduo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>core2duo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>athlon</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Westmere</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Snowridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Penryn</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G5</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G4</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Opteron_G1</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Nehalem</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Rome</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Milan</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Dhyana</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cooperlake</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Conroe</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>486</model>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:   </cpu>
Aug 17 08:10:01 user nova-compute[72998]:   <memoryBacking supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='sourceType'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>file</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>anonymous</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>memfd</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:   </memoryBacking>
Aug 17 08:10:01 user nova-compute[72998]:   <devices>
Aug 17 08:10:01 user nova-compute[72998]:     <disk supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='diskDevice'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>disk</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cdrom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>floppy</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>lun</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='bus'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ide</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>fdc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sata</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </disk>
Aug 17 08:10:01 user nova-compute[72998]:     <graphics supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sdl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vnc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>spice</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egl-headless</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </graphics>
Aug 17 08:10:01 user nova-compute[72998]:     <video supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='modelType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cirrus</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vmvga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>qxl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>none</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>bochs</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ramfb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </video>
Aug 17 08:10:01 user nova-compute[72998]:     <hostdev supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='mode'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>subsystem</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='startupPolicy'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>default</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>mandatory</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>requisite</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>optional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='subsysType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pci</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='capsType'/>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='pciBackend'/>
Aug 17 08:10:01 user nova-compute[72998]:     </hostdev>
Aug 17 08:10:01 user nova-compute[72998]:     <rng supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>random</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egd</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>builtin</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </rng>
Aug 17 08:10:01 user nova-compute[72998]:     <filesystem supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='driverType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>path</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>handle</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtiofs</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </filesystem>
Aug 17 08:10:01 user nova-compute[72998]:     <tpm supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-tis</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-crb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>passthrough</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>emulator</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </tpm>
Aug 17 08:10:01 user nova-compute[72998]:   </devices>
Aug 17 08:10:01 user nova-compute[72998]:   <features>
Aug 17 08:10:01 user nova-compute[72998]:     <gic supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:     <vmcoreinfo supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <genid supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backingStoreInput supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backup supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <sev supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:   </features>
Aug 17 08:10:01 user nova-compute[72998]: </domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:  {{(pid=72998) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 17 08:10:01 user nova-compute[72998]: <domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 08:10:01 user nova-compute[72998]:   <domain>kvm</domain>
Aug 17 08:10:01 user nova-compute[72998]:   <machine>pc-q35-jammy</machine>
Aug 17 08:10:01 user nova-compute[72998]:   <arch>x86_64</arch>
Aug 17 08:10:01 user nova-compute[72998]:   <vcpu max='288'/>
Aug 17 08:10:01 user nova-compute[72998]:   <iothreads supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:   <os supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='firmware'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>efi</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:     <loader supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>rom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pflash</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='readonly'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='secure'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </loader>
Aug 17 08:10:01 user nova-compute[72998]:   </os>
Aug 17 08:10:01 user nova-compute[72998]:   <cpu>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-passthrough' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='hostPassthroughMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='maximum' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='maximumMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-model' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <vendor>Intel</vendor>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ss'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='vmx'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pcid'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='hypervisor'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arat'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='umip'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='md-clear'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='invtsc'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibpb'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibrs'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='rsba'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='erms'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='custom' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>qemu64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>qemu32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>phenom</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>n270</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>coreduo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>core2duo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>athlon</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Westmere</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Snowridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Penryn</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G5</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G4</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Opteron_G1</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Nehalem</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Rome</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Milan</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Dhyana</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cooperlake</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Conroe</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>486</model>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:   </cpu>
Aug 17 08:10:01 user nova-compute[72998]:   <memoryBacking supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='sourceType'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>file</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>anonymous</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>memfd</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:   </memoryBacking>
Aug 17 08:10:01 user nova-compute[72998]:   <devices>
Aug 17 08:10:01 user nova-compute[72998]:     <disk supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='diskDevice'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>disk</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cdrom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>floppy</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>lun</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='bus'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>fdc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sata</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </disk>
Aug 17 08:10:01 user nova-compute[72998]:     <graphics supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sdl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vnc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>spice</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egl-headless</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </graphics>
Aug 17 08:10:01 user nova-compute[72998]:     <video supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='modelType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cirrus</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vmvga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>qxl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>none</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>bochs</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ramfb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </video>
Aug 17 08:10:01 user nova-compute[72998]:     <hostdev supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='mode'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>subsystem</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='startupPolicy'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>default</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>mandatory</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>requisite</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>optional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='subsysType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pci</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='capsType'/>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='pciBackend'/>
Aug 17 08:10:01 user nova-compute[72998]:     </hostdev>
Aug 17 08:10:01 user nova-compute[72998]:     <rng supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>random</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egd</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>builtin</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </rng>
Aug 17 08:10:01 user nova-compute[72998]:     <filesystem supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='driverType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>path</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>handle</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtiofs</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </filesystem>
Aug 17 08:10:01 user nova-compute[72998]:     <tpm supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-tis</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-crb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>passthrough</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>emulator</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </tpm>
Aug 17 08:10:01 user nova-compute[72998]:   </devices>
Aug 17 08:10:01 user nova-compute[72998]:   <features>
Aug 17 08:10:01 user nova-compute[72998]:     <gic supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:     <vmcoreinfo supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <genid supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backingStoreInput supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backup supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <sev supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:   </features>
Aug 17 08:10:01 user nova-compute[72998]: </domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:  {{(pid=72998) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 17 08:10:01 user nova-compute[72998]: <domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 08:10:01 user nova-compute[72998]:   <domain>kvm</domain>
Aug 17 08:10:01 user nova-compute[72998]:   <machine>pc-i440fx-6.2</machine>
Aug 17 08:10:01 user nova-compute[72998]:   <arch>x86_64</arch>
Aug 17 08:10:01 user nova-compute[72998]:   <vcpu max='255'/>
Aug 17 08:10:01 user nova-compute[72998]:   <iothreads supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:   <os supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='firmware'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>efi</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:     <loader supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>rom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pflash</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='readonly'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='secure'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </loader>
Aug 17 08:10:01 user nova-compute[72998]:   </os>
Aug 17 08:10:01 user nova-compute[72998]:   <cpu>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-passthrough' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='hostPassthroughMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='maximum' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='maximumMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-model' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <vendor>Intel</vendor>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ss'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='vmx'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pcid'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='hypervisor'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arat'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='umip'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='md-clear'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='invtsc'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibpb'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibrs'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='rsba'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='erms'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='custom' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>qemu64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>qemu32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>phenom</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>n270</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>coreduo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>core2duo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>athlon</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Westmere</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Snowridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Penryn</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G5</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G4</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Opteron_G1</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Nehalem</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Rome</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Milan</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Dhyana</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cooperlake</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Conroe</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>486</model>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:   </cpu>
Aug 17 08:10:01 user nova-compute[72998]:   <memoryBacking supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='sourceType'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>file</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>anonymous</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>memfd</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:   </memoryBacking>
Aug 17 08:10:01 user nova-compute[72998]:   <devices>
Aug 17 08:10:01 user nova-compute[72998]:     <disk supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='diskDevice'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>disk</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cdrom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>floppy</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>lun</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='bus'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ide</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>fdc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sata</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </disk>
Aug 17 08:10:01 user nova-compute[72998]:     <graphics supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sdl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vnc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>spice</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egl-headless</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </graphics>
Aug 17 08:10:01 user nova-compute[72998]:     <video supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='modelType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cirrus</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vmvga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>qxl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>none</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>bochs</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ramfb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </video>
Aug 17 08:10:01 user nova-compute[72998]:     <hostdev supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='mode'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>subsystem</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='startupPolicy'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>default</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>mandatory</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>requisite</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>optional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='subsysType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pci</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='capsType'/>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='pciBackend'/>
Aug 17 08:10:01 user nova-compute[72998]:     </hostdev>
Aug 17 08:10:01 user nova-compute[72998]:     <rng supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>random</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egd</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>builtin</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </rng>
Aug 17 08:10:01 user nova-compute[72998]:     <filesystem supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='driverType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>path</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>handle</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtiofs</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </filesystem>
Aug 17 08:10:01 user nova-compute[72998]:     <tpm supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-tis</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-crb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>passthrough</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>emulator</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </tpm>
Aug 17 08:10:01 user nova-compute[72998]:   </devices>
Aug 17 08:10:01 user nova-compute[72998]:   <features>
Aug 17 08:10:01 user nova-compute[72998]:     <gic supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:     <vmcoreinfo supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <genid supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backingStoreInput supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backup supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <sev supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:   </features>
Aug 17 08:10:01 user nova-compute[72998]: </domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:  {{(pid=72998) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 17 08:10:01 user nova-compute[72998]: <domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 08:10:01 user nova-compute[72998]:   <domain>kvm</domain>
Aug 17 08:10:01 user nova-compute[72998]:   <machine>pc-q35-6.2</machine>
Aug 17 08:10:01 user nova-compute[72998]:   <arch>x86_64</arch>
Aug 17 08:10:01 user nova-compute[72998]:   <vcpu max='288'/>
Aug 17 08:10:01 user nova-compute[72998]:   <iothreads supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:   <os supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='firmware'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>efi</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:     <loader supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>rom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pflash</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='readonly'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='secure'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>yes</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>no</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </loader>
Aug 17 08:10:01 user nova-compute[72998]:   </os>
Aug 17 08:10:01 user nova-compute[72998]:   <cpu>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-passthrough' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='hostPassthroughMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='maximum' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='maximumMigratable'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>on</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>off</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='host-model' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <vendor>Intel</vendor>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ss'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='vmx'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pcid'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='hypervisor'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arat'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='umip'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='md-clear'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='invtsc'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibpb'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='ibrs'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-stibp'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='rsba'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='erms'/>
Aug 17 08:10:01 user nova-compute[72998]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:     <mode name='custom' supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>qemu64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>qemu32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>phenom</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>pentium</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>n270</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm64</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>kvm32</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>coreduo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>core2duo</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>athlon</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Westmere</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Snowridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Skylake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>SandyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Penryn</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G5</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G4</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G3</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Opteron_G2</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Opteron_G1</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Nehalem</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>IvyBridge</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Icelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Haswell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Rome</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-Milan</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>EPYC</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Dhyana</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cooperlake</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>Conroe</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='no'>Broadwell</model>
Aug 17 08:10:01 user nova-compute[72998]:       <model usable='yes'>486</model>
Aug 17 08:10:01 user nova-compute[72998]:     </mode>
Aug 17 08:10:01 user nova-compute[72998]:   </cpu>
Aug 17 08:10:01 user nova-compute[72998]:   <memoryBacking supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:     <enum name='sourceType'>
Aug 17 08:10:01 user nova-compute[72998]:       <value>file</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>anonymous</value>
Aug 17 08:10:01 user nova-compute[72998]:       <value>memfd</value>
Aug 17 08:10:01 user nova-compute[72998]:     </enum>
Aug 17 08:10:01 user nova-compute[72998]:   </memoryBacking>
Aug 17 08:10:01 user nova-compute[72998]:   <devices>
Aug 17 08:10:01 user nova-compute[72998]:     <disk supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='diskDevice'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>disk</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cdrom</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>floppy</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>lun</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='bus'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>fdc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sata</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </disk>
Aug 17 08:10:01 user nova-compute[72998]:     <graphics supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='type'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>sdl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vnc</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>spice</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egl-headless</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </graphics>
Aug 17 08:10:01 user nova-compute[72998]:     <video supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='modelType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>cirrus</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>vmvga</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>qxl</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>none</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>bochs</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>ramfb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </video>
Aug 17 08:10:01 user nova-compute[72998]:     <hostdev supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='mode'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>subsystem</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='startupPolicy'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>default</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>mandatory</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>requisite</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>optional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='subsysType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>usb</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>pci</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>scsi</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='capsType'/>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='pciBackend'/>
Aug 17 08:10:01 user nova-compute[72998]:     </hostdev>
Aug 17 08:10:01 user nova-compute[72998]:     <rng supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtio-non-transitional</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>random</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>egd</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>builtin</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </rng>
Aug 17 08:10:01 user nova-compute[72998]:     <filesystem supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='driverType'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>path</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>handle</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>virtiofs</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </filesystem>
Aug 17 08:10:01 user nova-compute[72998]:     <tpm supported='yes'>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='model'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-tis</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>tpm-crb</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:       <enum name='backendModel'>
Aug 17 08:10:01 user nova-compute[72998]:         <value>passthrough</value>
Aug 17 08:10:01 user nova-compute[72998]:         <value>emulator</value>
Aug 17 08:10:01 user nova-compute[72998]:       </enum>
Aug 17 08:10:01 user nova-compute[72998]:     </tpm>
Aug 17 08:10:01 user nova-compute[72998]:   </devices>
Aug 17 08:10:01 user nova-compute[72998]:   <features>
Aug 17 08:10:01 user nova-compute[72998]:     <gic supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:     <vmcoreinfo supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <genid supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backingStoreInput supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <backup supported='yes'/>
Aug 17 08:10:01 user nova-compute[72998]:     <sev supported='no'/>
Aug 17 08:10:01 user nova-compute[72998]:   </features>
Aug 17 08:10:01 user nova-compute[72998]: </domainCapabilities>
Aug 17 08:10:01 user nova-compute[72998]:  {{(pid=72998) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72998) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72998) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Checking secure boot support for host arch (x86_64) {{(pid=72998) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Checking secure boot support for host arch (x86_64) {{(pid=72998) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Checking secure boot support for host arch (x86_64) {{(pid=72998) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 08:10:01 user nova-compute[72998]: INFO nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Secure Boot support detected
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] cpu compare xml: <cpu match="exact">
Aug 17 08:10:01 user nova-compute[72998]:   <model>Nehalem</model>
Aug 17 08:10:01 user nova-compute[72998]: </cpu>
Aug 17 08:10:01 user nova-compute[72998]:  {{(pid=72998) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 17 08:10:01 user nova-compute[72998]: INFO nova.virt.node [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Generated node identity fab9829a-6c05-4a2c-bb1e-0919bb928c91
Aug 17 08:10:01 user nova-compute[72998]: INFO nova.virt.node [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Wrote node identity fab9829a-6c05-4a2c-bb1e-0919bb928c91 to /opt/stack/data/nova/compute_id
Aug 17 08:10:01 user nova-compute[72998]: WARNING nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Compute nodes ['fab9829a-6c05-4a2c-bb1e-0919bb928c91'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 17 08:10:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 17 08:10:01 user nova-compute[72998]: WARNING nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 08:10:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:10:01 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:10:01 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Hypervisor/Node resource view: name=user free_ram=10854MB free_disk=25.159290313720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:10:01 user nova-compute[72998]: WARNING nova.compute.resource_tracker [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] No compute node record for user:fab9829a-6c05-4a2c-bb1e-0919bb928c91: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fab9829a-6c05-4a2c-bb1e-0919bb928c91 could not be found.
Aug 17 08:10:01 user nova-compute[72998]: INFO nova.compute.resource_tracker [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Compute node record created for user:user with uuid: fab9829a-6c05-4a2c-bb1e-0919bb928c91
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:10:01 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [req-c1de5219-eb1b-45ef-8752-2e2848dd275d] Created resource provider record via placement API for resource provider with UUID fab9829a-6c05-4a2c-bb1e-0919bb928c91 and name user.
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72998) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 17 08:10:01 user nova-compute[72998]: INFO nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] kernel doesn't support AMD SEV
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Libvirt baseline CPU <cpu>
Aug 17 08:10:01 user nova-compute[72998]:   <arch>x86_64</arch>
Aug 17 08:10:01 user nova-compute[72998]:   <model>Nehalem</model>
Aug 17 08:10:01 user nova-compute[72998]:   <vendor>Intel</vendor>
Aug 17 08:10:01 user nova-compute[72998]:   <topology sockets="6" cores="1" threads="1"/>
Aug 17 08:10:01 user nova-compute[72998]: </cpu>
Aug 17 08:10:01 user nova-compute[72998]:  {{(pid=72998) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Updated inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Updating resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 generation from 0 to 1 during operation: update_inventory {{(pid=72998) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 08:10:01 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:10:02 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Updating resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 generation from 1 to 2 during operation: update_traits {{(pid=72998) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 08:10:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:10:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:10:02 user nova-compute[72998]: DEBUG nova.service [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Creating RPC server for service compute {{(pid=72998) start /opt/stack/nova/nova/service.py:182}}
Aug 17 08:10:02 user nova-compute[72998]: DEBUG nova.service [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Join ServiceGroup membership for this service compute {{(pid=72998) start /opt/stack/nova/nova/service.py:199}}
Aug 17 08:10:02 user nova-compute[72998]: DEBUG nova.servicegroup.drivers.db [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72998) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 17 08:10:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:10:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:10:53 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:10:53 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:10:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=10269MB free_disk=25.063045501708984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:10:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:10:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:10:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:10:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:10:53 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:10:53 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:10:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:10:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:11:53 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:11:53 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:11:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=10180MB free_disk=25.109615325927734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:11:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:11:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:12:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:12:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:12:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:12:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:12:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:12:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:12:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:12:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:12:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:12:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:12:54 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:12:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:12:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:12:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=10163MB free_disk=24.89324188232422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:12:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:12:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:12:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:12:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:12:55 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:12:55 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:12:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:12:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:12:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:12:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:12:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:12:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:12:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:12:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:13:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:13:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:13:54 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:13:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:13:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:13:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=9457MB free_disk=24.915668487548828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:13:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:13:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:13:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:13:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:13:55 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:13:55 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:13:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:13:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:13:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:13:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:13:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:13:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:13:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:13:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:14:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:06 user nova-compute[72998]: INFO nova.compute.claims [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Claim successful on node user
Aug 17 08:14:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:06 user nova-compute[72998]: INFO nova.compute.claims [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Claim successful on node user
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:06 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:07 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Creating image(s)
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "/opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "/opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:07 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:07 user nova-compute[72998]: INFO nova.compute.claims [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Claim successful on node user
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.policy [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0be579ee85cb4ac2b59812bbee48c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62167eb6909402f8dca89678acff055', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.policy [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cf59502a7ee46968534c860fc9f49f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eaaef9c2492458bbe646bd227b11b64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:07 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Creating image(s)
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269.part --force-share --output=json" returned: 0 in 0.196s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.virt.images [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] 2fbaeab0-5441-4c6d-b8e6-2fab61f67348 was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269.part /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:08 user nova-compute[72998]: INFO nova.compute.claims [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Claim successful on node user
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269.part /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269.converted" returned: 0 in 0.404s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:08 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.442s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:08 user nova-compute[72998]: INFO oslo.privsep.daemon [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptl_hu_7t/privsep.sock']
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.762s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:08 user sudo[82279]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptl_hu_7t/privsep.sock
Aug 17 08:14:08 user sudo[82279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:08 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Creating image(s)
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "/opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "/opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "/opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:08 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.policy [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae660169ef314445b77c0dc8ad8c0e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2f87621e044e57be7a4632c3d4dba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:08 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Creating image(s)
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:09 user nova-compute[72998]: DEBUG nova.policy [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cf59502a7ee46968534c860fc9f49f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eaaef9c2492458bbe646bd227b11b64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Successfully created port: fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:10 user sudo[82279]: pam_unix(sudo:session): session closed for user root
Aug 17 08:14:10 user nova-compute[72998]: INFO oslo.privsep.daemon [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Spawned new privsep daemon via rootwrap
Aug 17 08:14:10 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 08:14:10 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 08:14:10 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 17 08:14:10 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82284
Aug 17 08:14:10 user nova-compute[72998]: WARNING oslo_privsep.priv_context [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] privsep daemon already running
Aug 17 08:14:10 user nova-compute[72998]: WARNING oslo_privsep.priv_context [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] privsep daemon already running
Aug 17 08:14:10 user nova-compute[72998]: WARNING oslo_privsep.priv_context [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] privsep daemon already running
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Successfully created port: 75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.160s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.250s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.210s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.241s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.243s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk 1073741824" returned: 0 in 0.046s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.264s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.198s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.193s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk 1073741824" returned: 0 in 0.050s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.528s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Cannot resize image /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lazy-loading 'migration_context' on Instance uuid cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Ensure instance console log exists: /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.188s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Successfully created port: b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk 1073741824" returned: 0 in 0.051s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Successfully created port: a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.773s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Cannot resize image /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'migration_context' on Instance uuid e2b811f8-19a3-4b50-8ea9-6d3442c38819 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Ensure instance console log exists: /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.223s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.212s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk 1073741824" returned: 0 in 0.058s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Cannot resize image /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'migration_context' on Instance uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Ensure instance console log exists: /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Cannot resize image /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'migration_context' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Ensure instance console log exists: /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Successfully updated port: fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquired lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-c117764a-9f11-413c-b900-8f78ac41f2e9 req-6a5b018c-4e10-4556-ae66-f809bf6c5bdb service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received event network-changed-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-c117764a-9f11-413c-b900-8f78ac41f2e9 req-6a5b018c-4e10-4556-ae66-f809bf6c5bdb service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Refreshing instance network info cache due to event network-changed-fcaef72a-ce0c-491a-a108-1b7a74c5c58e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c117764a-9f11-413c-b900-8f78ac41f2e9 req-6a5b018c-4e10-4556-ae66-f809bf6c5bdb service nova] Acquiring lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Successfully updated port: 75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquired lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:13 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-840666c3-5c09-418c-984f-8d07d3ade78d req-11183351-6847-4206-89b5-0d77d3c74522 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-changed-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-840666c3-5c09-418c-984f-8d07d3ade78d req-11183351-6847-4206-89b5-0d77d3c74522 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Refreshing instance network info cache due to event network-changed-75d77dae-ff35-4dee-a471-39e1476dd39e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-840666c3-5c09-418c-984f-8d07d3ade78d req-11183351-6847-4206-89b5-0d77d3c74522 service nova] Acquiring lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updating instance_info_cache with network_info: [{"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Releasing lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Instance network_info: |[{"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c117764a-9f11-413c-b900-8f78ac41f2e9 req-6a5b018c-4e10-4556-ae66-f809bf6c5bdb service nova] Acquired lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.network.neutron [req-c117764a-9f11-413c-b900-8f78ac41f2e9 req-6a5b018c-4e10-4556-ae66-f809bf6c5bdb service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Refreshing network info cache for port fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Start _get_guest_xml network_info=[{"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:14 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:14 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1603069519',display_name='tempest-ServerActionsTestOtherA-server-1603069519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1603069519',id=1,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwso8zXzyr8rdW+F3TIWTcGQW2195HR8rtDbyl+3RZbz4rT8sA0T1Nq594b2NMeWJ/ZCBUqUIDbRSEtao2k3JmymnhZIpHBjG50mdl6hk0l6mAeujcqHjcduFAXBAHWg==',key_name='tempest-keypair-622925506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-gq796j7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=e2b811f8-19a3-4b50-8ea9-6d3442c38819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:93:15,bridge_name='br-int',has_traffic_filtering=True,id=fcaef72a-ce0c-491a-a108-1b7a74c5c58e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcaef72a-ce') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'pci_devices' on Instance uuid e2b811f8-19a3-4b50-8ea9-6d3442c38819 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:14 user nova-compute[72998]:   <uuid>e2b811f8-19a3-4b50-8ea9-6d3442c38819</uuid>
Aug 17 08:14:14 user nova-compute[72998]:   <name>instance-00000001</name>
Aug 17 08:14:14 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:14 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:14 user nova-compute[72998]:   <metadata>
Aug 17 08:14:14 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:14 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:14 user nova-compute[72998]:       <nova:name>tempest-ServerActionsTestOtherA-server-1603069519</nova:name>
Aug 17 08:14:14 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:14</nova:creationTime>
Aug 17 08:14:14 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:14 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:14 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:14 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:14 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:14 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:14 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:14 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:14 user nova-compute[72998]:         <nova:user uuid="0be579ee85cb4ac2b59812bbee48c272">tempest-ServerActionsTestOtherA-1892042619-project-member</nova:user>
Aug 17 08:14:14 user nova-compute[72998]:         <nova:project uuid="d62167eb6909402f8dca89678acff055">tempest-ServerActionsTestOtherA-1892042619</nova:project>
Aug 17 08:14:14 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:14 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:14:14 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:14 user nova-compute[72998]:         <nova:port uuid="fcaef72a-ce0c-491a-a108-1b7a74c5c58e">
Aug 17 08:14:14 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 08:14:14 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:14 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:14 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:14 user nova-compute[72998]:   </metadata>
Aug 17 08:14:14 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:14 user nova-compute[72998]:     <system>
Aug 17 08:14:14 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:14 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:14 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:14 user nova-compute[72998]:       <entry name="serial">e2b811f8-19a3-4b50-8ea9-6d3442c38819</entry>
Aug 17 08:14:14 user nova-compute[72998]:       <entry name="uuid">e2b811f8-19a3-4b50-8ea9-6d3442c38819</entry>
Aug 17 08:14:14 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:14 user nova-compute[72998]:     </system>
Aug 17 08:14:14 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:14 user nova-compute[72998]:   <os>
Aug 17 08:14:14 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:14 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:14 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:14 user nova-compute[72998]:   </os>
Aug 17 08:14:14 user nova-compute[72998]:   <features>
Aug 17 08:14:14 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:14 user nova-compute[72998]:     <apic/>
Aug 17 08:14:14 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:14 user nova-compute[72998]:   </features>
Aug 17 08:14:14 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:14 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:14 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:14 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:14 user nova-compute[72998]:   </clock>
Aug 17 08:14:14 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:14 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:14 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:14 user nova-compute[72998]:   </cpu>
Aug 17 08:14:14 user nova-compute[72998]:   <devices>
Aug 17 08:14:14 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:14 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:14 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk"/>
Aug 17 08:14:14 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:14:14 user nova-compute[72998]:     </disk>
Aug 17 08:14:14 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:14 user nova-compute[72998]:       <mac address="fa:16:3e:eb:93:15"/>
Aug 17 08:14:14 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:14 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:14 user nova-compute[72998]:       <target dev="tapfcaef72a-ce"/>
Aug 17 08:14:14 user nova-compute[72998]:     </interface>
Aug 17 08:14:14 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:14 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/console.log" append="off"/>
Aug 17 08:14:14 user nova-compute[72998]:     </serial>
Aug 17 08:14:14 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:14 user nova-compute[72998]:     <video>
Aug 17 08:14:14 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:14 user nova-compute[72998]:     </video>
Aug 17 08:14:14 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:14 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:14 user nova-compute[72998]:     </rng>
Aug 17 08:14:14 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:14 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:14 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:14 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:14 user nova-compute[72998]:   </devices>
Aug 17 08:14:14 user nova-compute[72998]: </domain>
Aug 17 08:14:14 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1603069519',display_name='tempest-ServerActionsTestOtherA-server-1603069519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1603069519',id=1,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwso8zXzyr8rdW+F3TIWTcGQW2195HR8rtDbyl+3RZbz4rT8sA0T1Nq594b2NMeWJ/ZCBUqUIDbRSEtao2k3JmymnhZIpHBjG50mdl6hk0l6mAeujcqHjcduFAXBAHWg==',key_name='tempest-keypair-622925506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-gq796j7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=e2b811f8-19a3-4b50-8ea9-6d3442c38819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:93:15,bridge_name='br-int',has_traffic_filtering=True,id=fcaef72a-ce0c-491a-a108-1b7a74c5c58e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcaef72a-ce') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG os_vif [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:93:15,bridge_name='br-int',has_traffic_filtering=True,id=fcaef72a-ce0c-491a-a108-1b7a74c5c58e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcaef72a-ce') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Created schema index Interface.name {{(pid=72998) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Created schema index Port.name {{(pid=72998) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Created schema index Bridge.name {{(pid=72998) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [POLLOUT] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:14 user nova-compute[72998]: INFO oslo.privsep.daemon [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpt_2gyl9e/privsep.sock']
Aug 17 08:14:14 user sudo[82349]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpt_2gyl9e/privsep.sock
Aug 17 08:14:14 user sudo[82349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 08:14:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.neutron [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Successfully updated port: a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquired lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.neutron [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.neutron [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.neutron [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Successfully updated port: b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "refresh_cache-cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquired lock "refresh_cache-cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.neutron [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.neutron [req-c117764a-9f11-413c-b900-8f78ac41f2e9 req-6a5b018c-4e10-4556-ae66-f809bf6c5bdb service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updated VIF entry in instance network info cache for port fcaef72a-ce0c-491a-a108-1b7a74c5c58e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.neutron [req-c117764a-9f11-413c-b900-8f78ac41f2e9 req-6a5b018c-4e10-4556-ae66-f809bf6c5bdb service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updating instance_info_cache with network_info: [{"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c117764a-9f11-413c-b900-8f78ac41f2e9 req-6a5b018c-4e10-4556-ae66-f809bf6c5bdb service nova] Releasing lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updating instance_info_cache with network_info: [{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Releasing lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Instance network_info: |[{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-840666c3-5c09-418c-984f-8d07d3ade78d req-11183351-6847-4206-89b5-0d77d3c74522 service nova] Acquired lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.neutron [req-840666c3-5c09-418c-984f-8d07d3ade78d req-11183351-6847-4206-89b5-0d77d3c74522 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Refreshing network info cache for port 75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Start _get_guest_xml network_info=[{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:15 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:15 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1188743299',display_name='tempest-ServerRescueNegativeTestJSON-server-1188743299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1188743299',id=2,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-ixwnw5mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:07Z,user_data=None,user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=0d992c9b-66c8-4bd9-b78e-51e13d662144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:53:e1,bridge_name='br-int',has_traffic_filtering=True,id=75d77dae-ff35-4dee-a471-39e1476dd39e,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d77dae-ff') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:15 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG nova.network.neutron [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:16 user nova-compute[72998]:   <uuid>0d992c9b-66c8-4bd9-b78e-51e13d662144</uuid>
Aug 17 08:14:16 user nova-compute[72998]:   <name>instance-00000002</name>
Aug 17 08:14:16 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:16 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:16 user nova-compute[72998]:   <metadata>
Aug 17 08:14:16 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:16 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:16 user nova-compute[72998]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1188743299</nova:name>
Aug 17 08:14:16 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:15</nova:creationTime>
Aug 17 08:14:16 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:16 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:16 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:16 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:16 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:16 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:16 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:16 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:16 user nova-compute[72998]:         <nova:user uuid="4cf59502a7ee46968534c860fc9f49f5">tempest-ServerRescueNegativeTestJSON-826615417-project-member</nova:user>
Aug 17 08:14:16 user nova-compute[72998]:         <nova:project uuid="8eaaef9c2492458bbe646bd227b11b64">tempest-ServerRescueNegativeTestJSON-826615417</nova:project>
Aug 17 08:14:16 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:16 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:14:16 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:16 user nova-compute[72998]:         <nova:port uuid="75d77dae-ff35-4dee-a471-39e1476dd39e">
Aug 17 08:14:16 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 08:14:16 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:16 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:16 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:16 user nova-compute[72998]:   </metadata>
Aug 17 08:14:16 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:16 user nova-compute[72998]:     <system>
Aug 17 08:14:16 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:16 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:16 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:16 user nova-compute[72998]:       <entry name="serial">0d992c9b-66c8-4bd9-b78e-51e13d662144</entry>
Aug 17 08:14:16 user nova-compute[72998]:       <entry name="uuid">0d992c9b-66c8-4bd9-b78e-51e13d662144</entry>
Aug 17 08:14:16 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:16 user nova-compute[72998]:     </system>
Aug 17 08:14:16 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:16 user nova-compute[72998]:   <os>
Aug 17 08:14:16 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:16 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:16 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:16 user nova-compute[72998]:   </os>
Aug 17 08:14:16 user nova-compute[72998]:   <features>
Aug 17 08:14:16 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:16 user nova-compute[72998]:     <apic/>
Aug 17 08:14:16 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:16 user nova-compute[72998]:   </features>
Aug 17 08:14:16 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:16 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:16 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:16 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:16 user nova-compute[72998]:   </clock>
Aug 17 08:14:16 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:16 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:16 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:16 user nova-compute[72998]:   </cpu>
Aug 17 08:14:16 user nova-compute[72998]:   <devices>
Aug 17 08:14:16 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:16 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:16 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk"/>
Aug 17 08:14:16 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:14:16 user nova-compute[72998]:     </disk>
Aug 17 08:14:16 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:16 user nova-compute[72998]:       <mac address="fa:16:3e:55:53:e1"/>
Aug 17 08:14:16 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:16 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:16 user nova-compute[72998]:       <target dev="tap75d77dae-ff"/>
Aug 17 08:14:16 user nova-compute[72998]:     </interface>
Aug 17 08:14:16 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:16 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/console.log" append="off"/>
Aug 17 08:14:16 user nova-compute[72998]:     </serial>
Aug 17 08:14:16 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:16 user nova-compute[72998]:     <video>
Aug 17 08:14:16 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:16 user nova-compute[72998]:     </video>
Aug 17 08:14:16 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:16 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:16 user nova-compute[72998]:     </rng>
Aug 17 08:14:16 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:16 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:16 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:16 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:16 user nova-compute[72998]:   </devices>
Aug 17 08:14:16 user nova-compute[72998]: </domain>
Aug 17 08:14:16 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1188743299',display_name='tempest-ServerRescueNegativeTestJSON-server-1188743299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1188743299',id=2,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-ixwnw5mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:07Z,user_data=None,user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=0d992c9b-66c8-4bd9-b78e-51e13d662144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:53:e1,bridge_name='br-int',has_traffic_filtering=True,id=75d77dae-ff35-4dee-a471-39e1476dd39e,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d77dae-ff') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG os_vif [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:53:e1,bridge_name='br-int',has_traffic_filtering=True,id=75d77dae-ff35-4dee-a471-39e1476dd39e,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d77dae-ff') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-f3a19ea7-da74-4804-be97-02c249457f5f req-281c098a-37c8-4cf2-9b34-7f5a02d396fe service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received event network-changed-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-f3a19ea7-da74-4804-be97-02c249457f5f req-281c098a-37c8-4cf2-9b34-7f5a02d396fe service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Refreshing instance network info cache due to event network-changed-b9139967-deff-45c2-84d5-6234f414bcd4. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3a19ea7-da74-4804-be97-02c249457f5f req-281c098a-37c8-4cf2-9b34-7f5a02d396fe service nova] Acquiring lock "refresh_cache-cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-7d82482c-3096-4303-9096-63898763036a req-010b61f8-1558-4480-b737-00dca4666980 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-changed-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-7d82482c-3096-4303-9096-63898763036a req-010b61f8-1558-4480-b737-00dca4666980 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Refreshing instance network info cache due to event network-changed-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7d82482c-3096-4303-9096-63898763036a req-010b61f8-1558-4480-b737-00dca4666980 service nova] Acquiring lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:16 user sudo[82349]: pam_unix(sudo:session): session closed for user root
Aug 17 08:14:16 user nova-compute[72998]: INFO oslo.privsep.daemon [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Spawned new privsep daemon via rootwrap
Aug 17 08:14:17 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 08:14:17 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 08:14:17 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 17 08:14:17 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82354
Aug 17 08:14:17 user nova-compute[72998]: WARNING oslo_privsep.priv_context [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] privsep daemon already running
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Updating instance_info_cache with network_info: [{"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Releasing lock "refresh_cache-cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Instance network_info: |[{"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3a19ea7-da74-4804-be97-02c249457f5f req-281c098a-37c8-4cf2-9b34-7f5a02d396fe service nova] Acquired lock "refresh_cache-cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.network.neutron [req-f3a19ea7-da74-4804-be97-02c249457f5f req-281c098a-37c8-4cf2-9b34-7f5a02d396fe service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Refreshing network info cache for port b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Start _get_guest_xml network_info=[{"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:17 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:17 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-262231603',display_name='tempest-DeleteServersTestJSON-server-262231603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-262231603',id=3,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c2f87621e044e57be7a4632c3d4dba3',ramdisk_id='',reservation_id='r-51kgvb5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-712265908',owner_user_name='tempest-DeleteServersTestJSON-712265908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:09Z,user_data=None,user_id='ae660169ef314445b77c0dc8ad8c0e46',uuid=cda1f6e2-bdea-4d64-bdde-e7a839cae7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Converting VIF {"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:a9,bridge_name='br-int',has_traffic_filtering=True,id=b9139967-deff-45c2-84d5-6234f414bcd4,network=Network(822fa31f-5d57-4813-8cd2-73f065be4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9139967-de') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.objects.instance [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lazy-loading 'pci_devices' on Instance uuid cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:17 user nova-compute[72998]:   <uuid>cda1f6e2-bdea-4d64-bdde-e7a839cae7e6</uuid>
Aug 17 08:14:17 user nova-compute[72998]:   <name>instance-00000003</name>
Aug 17 08:14:17 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:17 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:17 user nova-compute[72998]:   <metadata>
Aug 17 08:14:17 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:17 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:17 user nova-compute[72998]:       <nova:name>tempest-DeleteServersTestJSON-server-262231603</nova:name>
Aug 17 08:14:17 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:17</nova:creationTime>
Aug 17 08:14:17 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:17 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:17 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:17 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:17 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:17 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:17 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:17 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:17 user nova-compute[72998]:         <nova:user uuid="ae660169ef314445b77c0dc8ad8c0e46">tempest-DeleteServersTestJSON-712265908-project-member</nova:user>
Aug 17 08:14:17 user nova-compute[72998]:         <nova:project uuid="2c2f87621e044e57be7a4632c3d4dba3">tempest-DeleteServersTestJSON-712265908</nova:project>
Aug 17 08:14:17 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:17 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:14:17 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:17 user nova-compute[72998]:         <nova:port uuid="b9139967-deff-45c2-84d5-6234f414bcd4">
Aug 17 08:14:17 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 08:14:17 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:17 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:17 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:17 user nova-compute[72998]:   </metadata>
Aug 17 08:14:17 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:17 user nova-compute[72998]:     <system>
Aug 17 08:14:17 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:17 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:17 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:17 user nova-compute[72998]:       <entry name="serial">cda1f6e2-bdea-4d64-bdde-e7a839cae7e6</entry>
Aug 17 08:14:17 user nova-compute[72998]:       <entry name="uuid">cda1f6e2-bdea-4d64-bdde-e7a839cae7e6</entry>
Aug 17 08:14:17 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:17 user nova-compute[72998]:     </system>
Aug 17 08:14:17 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:17 user nova-compute[72998]:   <os>
Aug 17 08:14:17 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:17 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:17 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:17 user nova-compute[72998]:   </os>
Aug 17 08:14:17 user nova-compute[72998]:   <features>
Aug 17 08:14:17 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:17 user nova-compute[72998]:     <apic/>
Aug 17 08:14:17 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:17 user nova-compute[72998]:   </features>
Aug 17 08:14:17 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:17 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:17 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:17 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:17 user nova-compute[72998]:   </clock>
Aug 17 08:14:17 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:17 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:17 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:17 user nova-compute[72998]:   </cpu>
Aug 17 08:14:17 user nova-compute[72998]:   <devices>
Aug 17 08:14:17 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:17 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:17 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk"/>
Aug 17 08:14:17 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:14:17 user nova-compute[72998]:     </disk>
Aug 17 08:14:17 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:17 user nova-compute[72998]:       <mac address="fa:16:3e:bb:8b:a9"/>
Aug 17 08:14:17 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:17 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:17 user nova-compute[72998]:       <target dev="tapb9139967-de"/>
Aug 17 08:14:17 user nova-compute[72998]:     </interface>
Aug 17 08:14:17 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:17 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/console.log" append="off"/>
Aug 17 08:14:17 user nova-compute[72998]:     </serial>
Aug 17 08:14:17 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:17 user nova-compute[72998]:     <video>
Aug 17 08:14:17 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:17 user nova-compute[72998]:     </video>
Aug 17 08:14:17 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:17 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:17 user nova-compute[72998]:     </rng>
Aug 17 08:14:17 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:17 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:17 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:17 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:17 user nova-compute[72998]:   </devices>
Aug 17 08:14:17 user nova-compute[72998]: </domain>
Aug 17 08:14:17 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-262231603',display_name='tempest-DeleteServersTestJSON-server-262231603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-262231603',id=3,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c2f87621e044e57be7a4632c3d4dba3',ramdisk_id='',reservation_id='r-51kgvb5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-712265908',owner_user_name='tempest-DeleteServersTestJSON-712265908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:09Z,user_data=None,user_id='ae660169ef314445b77c0dc8ad8c0e46',uuid=cda1f6e2-bdea-4d64-bdde-e7a839cae7e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Converting VIF {"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:a9,bridge_name='br-int',has_traffic_filtering=True,id=b9139967-deff-45c2-84d5-6234f414bcd4,network=Network(822fa31f-5d57-4813-8cd2-73f065be4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9139967-de') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG os_vif [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:a9,bridge_name='br-int',has_traffic_filtering=True,id=b9139967-deff-45c2-84d5-6234f414bcd4,network=Network(822fa31f-5d57-4813-8cd2-73f065be4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9139967-de') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcaef72a-ce, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcaef72a-ce, col_values=(('external_ids', {'iface-id': 'fcaef72a-ce0c-491a-a108-1b7a74c5c58e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:93:15', 'vm-uuid': 'e2b811f8-19a3-4b50-8ea9-6d3442c38819'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: INFO os_vif [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:93:15,bridge_name='br-int',has_traffic_filtering=True,id=fcaef72a-ce0c-491a-a108-1b7a74c5c58e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcaef72a-ce')
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75d77dae-ff, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75d77dae-ff, col_values=(('external_ids', {'iface-id': '75d77dae-ff35-4dee-a471-39e1476dd39e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:53:e1', 'vm-uuid': '0d992c9b-66c8-4bd9-b78e-51e13d662144'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: INFO os_vif [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:53:e1,bridge_name='br-int',has_traffic_filtering=True,id=75d77dae-ff35-4dee-a471-39e1476dd39e,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d77dae-ff')
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9139967-de, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9139967-de, col_values=(('external_ids', {'iface-id': 'b9139967-deff-45c2-84d5-6234f414bcd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:8b:a9', 'vm-uuid': 'cda1f6e2-bdea-4d64-bdde-e7a839cae7e6'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:17 user nova-compute[72998]: INFO os_vif [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:a9,bridge_name='br-int',has_traffic_filtering=True,id=b9139967-deff-45c2-84d5-6234f414bcd4,network=Network(822fa31f-5d57-4813-8cd2-73f065be4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9139967-de')
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No VIF found with MAC fa:16:3e:eb:93:15, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No VIF found with MAC fa:16:3e:55:53:e1, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updating instance_info_cache with network_info: [{"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] No VIF found with MAC fa:16:3e:bb:8b:a9, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Releasing lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Instance network_info: |[{"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7d82482c-3096-4303-9096-63898763036a req-010b61f8-1558-4480-b737-00dca4666980 service nova] Acquired lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:17 user nova-compute[72998]: DEBUG nova.network.neutron [req-7d82482c-3096-4303-9096-63898763036a req-010b61f8-1558-4480-b737-00dca4666980 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Refreshing network info cache for port a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Start _get_guest_xml network_info=[{"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2108467117',display_name='tempest-ServerRescueNegativeTestJSON-server-2108467117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2108467117',id=4,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-zpdtk9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:09Z,user_data=None,user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=7b895ebd-5c4d-4350-9cbc-39e427e0cb05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:ba,bridge_name='br-int',has_traffic_filtering=True,id=a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8370d19-8e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.objects.instance [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:18 user nova-compute[72998]:   <uuid>7b895ebd-5c4d-4350-9cbc-39e427e0cb05</uuid>
Aug 17 08:14:18 user nova-compute[72998]:   <name>instance-00000004</name>
Aug 17 08:14:18 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:18 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:18 user nova-compute[72998]:   <metadata>
Aug 17 08:14:18 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:18 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:18 user nova-compute[72998]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2108467117</nova:name>
Aug 17 08:14:18 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:18</nova:creationTime>
Aug 17 08:14:18 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:18 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:18 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:18 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:18 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:18 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:18 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:18 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:18 user nova-compute[72998]:         <nova:user uuid="4cf59502a7ee46968534c860fc9f49f5">tempest-ServerRescueNegativeTestJSON-826615417-project-member</nova:user>
Aug 17 08:14:18 user nova-compute[72998]:         <nova:project uuid="8eaaef9c2492458bbe646bd227b11b64">tempest-ServerRescueNegativeTestJSON-826615417</nova:project>
Aug 17 08:14:18 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:18 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:14:18 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:18 user nova-compute[72998]:         <nova:port uuid="a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3">
Aug 17 08:14:18 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 08:14:18 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:18 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:18 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:18 user nova-compute[72998]:   </metadata>
Aug 17 08:14:18 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:18 user nova-compute[72998]:     <system>
Aug 17 08:14:18 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:18 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:18 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:18 user nova-compute[72998]:       <entry name="serial">7b895ebd-5c4d-4350-9cbc-39e427e0cb05</entry>
Aug 17 08:14:18 user nova-compute[72998]:       <entry name="uuid">7b895ebd-5c4d-4350-9cbc-39e427e0cb05</entry>
Aug 17 08:14:18 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:18 user nova-compute[72998]:     </system>
Aug 17 08:14:18 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:18 user nova-compute[72998]:   <os>
Aug 17 08:14:18 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:18 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:18 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:18 user nova-compute[72998]:   </os>
Aug 17 08:14:18 user nova-compute[72998]:   <features>
Aug 17 08:14:18 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:18 user nova-compute[72998]:     <apic/>
Aug 17 08:14:18 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:18 user nova-compute[72998]:   </features>
Aug 17 08:14:18 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:18 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:18 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:18 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:18 user nova-compute[72998]:   </clock>
Aug 17 08:14:18 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:18 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:18 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:18 user nova-compute[72998]:   </cpu>
Aug 17 08:14:18 user nova-compute[72998]:   <devices>
Aug 17 08:14:18 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:18 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:18 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk"/>
Aug 17 08:14:18 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:14:18 user nova-compute[72998]:     </disk>
Aug 17 08:14:18 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:18 user nova-compute[72998]:       <mac address="fa:16:3e:7f:c7:ba"/>
Aug 17 08:14:18 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:18 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:18 user nova-compute[72998]:       <target dev="tapa8370d19-8e"/>
Aug 17 08:14:18 user nova-compute[72998]:     </interface>
Aug 17 08:14:18 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:18 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/console.log" append="off"/>
Aug 17 08:14:18 user nova-compute[72998]:     </serial>
Aug 17 08:14:18 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:18 user nova-compute[72998]:     <video>
Aug 17 08:14:18 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:18 user nova-compute[72998]:     </video>
Aug 17 08:14:18 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:18 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:18 user nova-compute[72998]:     </rng>
Aug 17 08:14:18 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:18 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:18 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:18 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:18 user nova-compute[72998]:   </devices>
Aug 17 08:14:18 user nova-compute[72998]: </domain>
Aug 17 08:14:18 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2108467117',display_name='tempest-ServerRescueNegativeTestJSON-server-2108467117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2108467117',id=4,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-zpdtk9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:09Z,user_data=None,user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=7b895ebd-5c4d-4350-9cbc-39e427e0cb05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:ba,bridge_name='br-int',has_traffic_filtering=True,id=a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8370d19-8e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG os_vif [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:ba,bridge_name='br-int',has_traffic_filtering=True,id=a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8370d19-8e') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8370d19-8e, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8370d19-8e, col_values=(('external_ids', {'iface-id': 'a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:c7:ba', 'vm-uuid': '7b895ebd-5c4d-4350-9cbc-39e427e0cb05'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:18 user nova-compute[72998]: INFO os_vif [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:ba,bridge_name='br-int',has_traffic_filtering=True,id=a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8370d19-8e')
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-f3a19ea7-da74-4804-be97-02c249457f5f req-281c098a-37c8-4cf2-9b34-7f5a02d396fe service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Updated VIF entry in instance network info cache for port b9139967-deff-45c2-84d5-6234f414bcd4. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-f3a19ea7-da74-4804-be97-02c249457f5f req-281c098a-37c8-4cf2-9b34-7f5a02d396fe service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Updating instance_info_cache with network_info: [{"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3a19ea7-da74-4804-be97-02c249457f5f req-281c098a-37c8-4cf2-9b34-7f5a02d396fe service nova] Releasing lock "refresh_cache-cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No VIF found with MAC fa:16:3e:7f:c7:ba, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:19 user nova-compute[72998]: DEBUG nova.network.neutron [req-840666c3-5c09-418c-984f-8d07d3ade78d req-11183351-6847-4206-89b5-0d77d3c74522 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updated VIF entry in instance network info cache for port 75d77dae-ff35-4dee-a471-39e1476dd39e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:14:19 user nova-compute[72998]: DEBUG nova.network.neutron [req-840666c3-5c09-418c-984f-8d07d3ade78d req-11183351-6847-4206-89b5-0d77d3c74522 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updating instance_info_cache with network_info: [{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-840666c3-5c09-418c-984f-8d07d3ade78d req-11183351-6847-4206-89b5-0d77d3c74522 service nova] Releasing lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:21 user nova-compute[72998]: DEBUG nova.network.neutron [req-7d82482c-3096-4303-9096-63898763036a req-010b61f8-1558-4480-b737-00dca4666980 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updated VIF entry in instance network info cache for port a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:14:21 user nova-compute[72998]: DEBUG nova.network.neutron [req-7d82482c-3096-4303-9096-63898763036a req-010b61f8-1558-4480-b737-00dca4666980 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updating instance_info_cache with network_info: [{"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7d82482c-3096-4303-9096-63898763036a req-010b61f8-1558-4480-b737-00dca4666980 service nova] Releasing lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-b2cd7671-73e7-41c5-b3c2-09c792fa5d4e req-1ab198c4-6877-4d6c-af24-3e7116424bff service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received event network-vif-plugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b2cd7671-73e7-41c5-b3c2-09c792fa5d4e req-1ab198c4-6877-4d6c-af24-3e7116424bff service nova] Acquiring lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b2cd7671-73e7-41c5-b3c2-09c792fa5d4e req-1ab198c4-6877-4d6c-af24-3e7116424bff service nova] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b2cd7671-73e7-41c5-b3c2-09c792fa5d4e req-1ab198c4-6877-4d6c-af24-3e7116424bff service nova] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-b2cd7671-73e7-41c5-b3c2-09c792fa5d4e req-1ab198c4-6877-4d6c-af24-3e7116424bff service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] No waiting events found dispatching network-vif-plugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:22 user nova-compute[72998]: WARNING nova.compute.manager [req-b2cd7671-73e7-41c5-b3c2-09c792fa5d4e req-1ab198c4-6877-4d6c-af24-3e7116424bff service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received unexpected event network-vif-plugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e for instance with vm_state building and task_state spawning.
Aug 17 08:14:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-5e47c046-4e9a-48c3-bc0e-98b215c2f4b8 req-31cf5bda-45b9-488b-a1eb-86cf86bc8eca service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received event network-vif-plugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5e47c046-4e9a-48c3-bc0e-98b215c2f4b8 req-31cf5bda-45b9-488b-a1eb-86cf86bc8eca service nova] Acquiring lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5e47c046-4e9a-48c3-bc0e-98b215c2f4b8 req-31cf5bda-45b9-488b-a1eb-86cf86bc8eca service nova] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5e47c046-4e9a-48c3-bc0e-98b215c2f4b8 req-31cf5bda-45b9-488b-a1eb-86cf86bc8eca service nova] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-5e47c046-4e9a-48c3-bc0e-98b215c2f4b8 req-31cf5bda-45b9-488b-a1eb-86cf86bc8eca service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] No waiting events found dispatching network-vif-plugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:24 user nova-compute[72998]: WARNING nova.compute.manager [req-5e47c046-4e9a-48c3-bc0e-98b215c2f4b8 req-31cf5bda-45b9-488b-a1eb-86cf86bc8eca service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received unexpected event network-vif-plugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e for instance with vm_state building and task_state spawning.
Aug 17 08:14:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260066.0290463, 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] VM Resumed (Lifecycle Event)
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Instance spawned successfully.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Took 17.27 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Instance spawned successfully.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260066.0348928, 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] VM Started (Lifecycle Event)
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260066.2394264, 0d992c9b-66c8-4bd9-b78e-51e13d662144 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] VM Resumed (Lifecycle Event)
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Took 18.19 seconds to build instance.
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Instance spawned successfully.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Instance spawned successfully.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-07e651ea-da2f-4868-87e2-94798605123c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.429s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260066.240187, 0d992c9b-66c8-4bd9-b78e-51e13d662144 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] VM Started (Lifecycle Event)
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Took 19.54 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Took 18.85 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260066.4073377, e2b811f8-19a3-4b50-8ea9-6d3442c38819 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] VM Resumed (Lifecycle Event)
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Took 18.12 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:26 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260066.4082553, e2b811f8-19a3-4b50-8ea9-6d3442c38819 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] VM Started (Lifecycle Event)
Aug 17 08:14:27 user nova-compute[72998]: INFO nova.compute.manager [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Took 20.26 seconds to build instance.
Aug 17 08:14:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7210c824-daf8-42bb-b0f9-c07e9e1c6a88 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.437s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:27 user nova-compute[72998]: INFO nova.compute.manager [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Took 20.87 seconds to build instance.
Aug 17 08:14:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260066.409997, cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:27 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] VM Resumed (Lifecycle Event)
Aug 17 08:14:27 user nova-compute[72998]: INFO nova.compute.manager [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Took 19.88 seconds to build instance.
Aug 17 08:14:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5239015-327c-4cf8-8d7f-d9de21ecbc34 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.338s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260066.4126077, cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:27 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] VM Started (Lifecycle Event)
Aug 17 08:14:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-80af694e-aade-45a4-b571-5d1bf58453e5 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.137s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:28 user nova-compute[72998]: INFO nova.compute.claims [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Claim successful on node user
Aug 17 08:14:28 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.821s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Creating image(s)
Aug 17 08:14:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "/opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "/opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG nova.policy [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e09e792e114f4e39a78f5bc4f7c83279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5a18b85c6664687aac505b5b72077b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.328s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.333s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk 1073741824" returned: 0 in 0.086s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.426s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.383s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-39c8aea8-4552-4a40-bbe1-a275a9c38e7e req-6d34f986-ae4b-4f40-b340-42f0392ba3bd service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-39c8aea8-4552-4a40-bbe1-a275a9c38e7e req-6d34f986-ae4b-4f40-b340-42f0392ba3bd service nova] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-39c8aea8-4552-4a40-bbe1-a275a9c38e7e req-6d34f986-ae4b-4f40-b340-42f0392ba3bd service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-39c8aea8-4552-4a40-bbe1-a275a9c38e7e req-6d34f986-ae4b-4f40-b340-42f0392ba3bd service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-39c8aea8-4552-4a40-bbe1-a275a9c38e7e req-6d34f986-ae4b-4f40-b340-42f0392ba3bd service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] No waiting events found dispatching network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:30 user nova-compute[72998]: WARNING nova.compute.manager [req-39c8aea8-4552-4a40-bbe1-a275a9c38e7e req-6d34f986-ae4b-4f40-b340-42f0392ba3bd service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received unexpected event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 for instance with vm_state active and task_state None.
Aug 17 08:14:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json" returned: 0 in 0.387s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Cannot resize image /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lazy-loading 'migration_context' on Instance uuid ffb74821-5eff-4099-8bb6-d35d33ad1b87 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Ensure instance console log exists: /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquiring lock "1178b496-7709-411f-a789-766d6eea004b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "1178b496-7709-411f-a789-766d6eea004b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:31 user nova-compute[72998]: DEBUG nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:32 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:32 user nova-compute[72998]: INFO nova.compute.claims [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Claim successful on node user
Aug 17 08:14:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:32 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:32 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.857s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG nova.network.neutron [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-7f8bccd3-a89e-4df8-9ca4-121c346ad4bd req-1e6459cd-51a8-450e-9069-7f189882b229 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7f8bccd3-a89e-4df8-9ca4-121c346ad4bd req-1e6459cd-51a8-450e-9069-7f189882b229 service nova] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7f8bccd3-a89e-4df8-9ca4-121c346ad4bd req-1e6459cd-51a8-450e-9069-7f189882b229 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7f8bccd3-a89e-4df8-9ca4-121c346ad4bd req-1e6459cd-51a8-450e-9069-7f189882b229 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-7f8bccd3-a89e-4df8-9ca4-121c346ad4bd req-1e6459cd-51a8-450e-9069-7f189882b229 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] No waiting events found dispatching network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:33 user nova-compute[72998]: WARNING nova.compute.manager [req-7f8bccd3-a89e-4df8-9ca4-121c346ad4bd req-1e6459cd-51a8-450e-9069-7f189882b229 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received unexpected event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 for instance with vm_state active and task_state None.
Aug 17 08:14:33 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Successfully created port: adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:33 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Creating image(s)
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquiring lock "/opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "/opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "/opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.031s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.293s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG nova.policy [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3db31250e9e4e71853b077aef0af43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7aae117654398996e22cb255c8584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.272s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk 1073741824" returned: 0 in 0.094s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.375s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.361s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Cannot resize image /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG nova.objects.instance [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lazy-loading 'migration_context' on Instance uuid 1178b496-7709-411f-a789-766d6eea004b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Ensure instance console log exists: /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:35 user nova-compute[72998]: INFO nova.compute.claims [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Claim successful on node user
Aug 17 08:14:35 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:35 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG nova.policy [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6bb04fc09a44f4984fcafe9a36a5697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189a8d5df1724c5799dafc741f135973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Creating image(s)
Aug 17 08:14:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "/opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "/opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "/opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "e580a7a694e1cfba70f35c9788d1358f07803c7a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "e580a7a694e1cfba70f35c9788d1358f07803c7a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a.part --force-share --output=json" returned: 0 in 0.342s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG nova.virt.images [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] 17954092-02cf-4e7c-9f84-8786cce2ff8c was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a.part /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Successfully created port: 10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a.part /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a.converted" returned: 0 in 0.397s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:38 user nova-compute[72998]: INFO nova.compute.claims [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Claim successful on node user
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a.converted --force-share --output=json" returned: 0 in 0.316s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "e580a7a694e1cfba70f35c9788d1358f07803c7a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.890s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-6129136a-8937-4af7-99a6-8dfba53f5179 req-e3b5d395-8d1d-4b84-855f-a2c0df27df1a service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6129136a-8937-4af7-99a6-8dfba53f5179 req-e3b5d395-8d1d-4b84-855f-a2c0df27df1a service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6129136a-8937-4af7-99a6-8dfba53f5179 req-e3b5d395-8d1d-4b84-855f-a2c0df27df1a service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6129136a-8937-4af7-99a6-8dfba53f5179 req-e3b5d395-8d1d-4b84-855f-a2c0df27df1a service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-6129136a-8937-4af7-99a6-8dfba53f5179 req-e3b5d395-8d1d-4b84-855f-a2c0df27df1a service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:38 user nova-compute[72998]: WARNING nova.compute.manager [req-6129136a-8937-4af7-99a6-8dfba53f5179 req-e3b5d395-8d1d-4b84-855f-a2c0df27df1a service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state active and task_state None.
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a --force-share --output=json" returned: 0 in 0.300s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "e580a7a694e1cfba70f35c9788d1358f07803c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "e580a7a694e1cfba70f35c9788d1358f07803c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG nova.network.neutron [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Successfully created port: 91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:38 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a --force-share --output=json" returned: 0 in 0.388s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a,backing_fmt=raw /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Successfully updated port: 10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Successfully updated port: adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-8b6f8282-940a-43f9-85fc-983c92fc504a req-fc78b415-352c-4918-9ec2-56eba00060b1 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received event network-changed-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-8b6f8282-940a-43f9-85fc-983c92fc504a req-fc78b415-352c-4918-9ec2-56eba00060b1 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Refreshing instance network info cache due to event network-changed-10a46c87-9138-48a8-8228-2bf4501448b1. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8b6f8282-940a-43f9-85fc-983c92fc504a req-fc78b415-352c-4918-9ec2-56eba00060b1 service nova] Acquiring lock "refresh_cache-a06900f6-a39f-422f-a7c3-c89e1574602b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8b6f8282-940a-43f9-85fc-983c92fc504a req-fc78b415-352c-4918-9ec2-56eba00060b1 service nova] Acquired lock "refresh_cache-a06900f6-a39f-422f-a7c3-c89e1574602b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-8b6f8282-940a-43f9-85fc-983c92fc504a req-fc78b415-352c-4918-9ec2-56eba00060b1 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Refreshing network info cache for port 10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a,backing_fmt=raw /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk 1073741824" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.network.neutron [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "e580a7a694e1cfba70f35c9788d1358f07803c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.585s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquiring lock "refresh_cache-ffb74821-5eff-4099-8bb6-d35d33ad1b87" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquired lock "refresh_cache-ffb74821-5eff-4099-8bb6-d35d33ad1b87" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.007s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "refresh_cache-a06900f6-a39f-422f-a7c3-c89e1574602b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-00717feb-70df-488d-b26b-b23b3261782f req-29d8e98e-1482-43be-b33c-a99006138c25 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received event network-changed-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-00717feb-70df-488d-b26b-b23b3261782f req-29d8e98e-1482-43be-b33c-a99006138c25 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Refreshing instance network info cache due to event network-changed-adc18de6-340a-44b0-814b-f1c5345805f7. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-00717feb-70df-488d-b26b-b23b3261782f req-29d8e98e-1482-43be-b33c-a99006138c25 service nova] Acquiring lock "refresh_cache-ffb74821-5eff-4099-8bb6-d35d33ad1b87" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a --force-share --output=json" returned: 0 in 0.247s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-8b6f8282-940a-43f9-85fc-983c92fc504a req-fc78b415-352c-4918-9ec2-56eba00060b1 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:39 user nova-compute[72998]: INFO nova.compute.claims [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Claim successful on node user
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.policy [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14c6925b804342b7bee762e57a0fe9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9985c560f34f4991b6cb938d8b6fcd57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Creating image(s)
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json" returned: 0 in 0.349s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Cannot resize image /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lazy-loading 'migration_context' on Instance uuid a06900f6-a39f-422f-a7c3-c89e1574602b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Ensure instance console log exists: /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.213s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.network.neutron [req-8b6f8282-940a-43f9-85fc-983c92fc504a req-fc78b415-352c-4918-9ec2-56eba00060b1 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8b6f8282-940a-43f9-85fc-983c92fc504a req-fc78b415-352c-4918-9ec2-56eba00060b1 service nova] Releasing lock "refresh_cache-a06900f6-a39f-422f-a7c3-c89e1574602b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquired lock "refresh_cache-a06900f6-a39f-422f-a7c3-c89e1574602b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.227s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk 1073741824" returned: 0 in 0.059s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-c5180deb-ed79-429c-803d-3850f6237a14 req-c07c7729-bcb0-4db6-a08a-d6fac14fb872 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c5180deb-ed79-429c-803d-3850f6237a14 req-c07c7729-bcb0-4db6-a08a-d6fac14fb872 service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c5180deb-ed79-429c-803d-3850f6237a14 req-c07c7729-bcb0-4db6-a08a-d6fac14fb872 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c5180deb-ed79-429c-803d-3850f6237a14 req-c07c7729-bcb0-4db6-a08a-d6fac14fb872 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-c5180deb-ed79-429c-803d-3850f6237a14 req-c07c7729-bcb0-4db6-a08a-d6fac14fb872 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:40 user nova-compute[72998]: WARNING nova.compute.manager [req-c5180deb-ed79-429c-803d-3850f6237a14 req-c07c7729-bcb0-4db6-a08a-d6fac14fb872 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state active and task_state None.
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.083s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.340s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.policy [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e444ed21ebed454cb5c30943a5725f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b23b971dd054295802333297815ee12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Updating instance_info_cache with network_info: [{"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Releasing lock "refresh_cache-ffb74821-5eff-4099-8bb6-d35d33ad1b87" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Instance network_info: |[{"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-00717feb-70df-488d-b26b-b23b3261782f req-29d8e98e-1482-43be-b33c-a99006138c25 service nova] Acquired lock "refresh_cache-ffb74821-5eff-4099-8bb6-d35d33ad1b87" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.network.neutron [req-00717feb-70df-488d-b26b-b23b3261782f req-29d8e98e-1482-43be-b33c-a99006138c25 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Refreshing network info cache for port adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Start _get_guest_xml network_info=[{"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Cannot resize image /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.objects.instance [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lazy-loading 'migration_context' on Instance uuid e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Creating image(s)
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "/opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "/opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Ensure instance console log exists: /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:40 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:40 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1767592221',display_name='tempest-VolumesAssistedSnapshotsTest-server-1767592221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1767592221',id=5,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL03JcvDTiyZtspb484FKd4yUO9MGouQBcvtg2oJL0koXTGKNyi5Pk/MSPDJTUOFn/l/37KtH3u7mYbMlLGVMtUU+7ZC6QHzq17LatOyZtY5/g0T22hnszzOuPBro5W8sw==',key_name='tempest-keypair-1579729383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5a18b85c6664687aac505b5b72077b7',ramdisk_id='',reservation_id='r-py3e3qko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1422585177',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1422585177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e09e792e114f4e39a78f5bc4f7c83279',uuid=ffb74821-5eff-4099-8bb6-d35d33ad1b87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Converting VIF {"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:d7:33,bridge_name='br-int',has_traffic_filtering=True,id=adc18de6-340a-44b0-814b-f1c5345805f7,network=Network(7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc18de6-34') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.objects.instance [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lazy-loading 'pci_devices' on Instance uuid ffb74821-5eff-4099-8bb6-d35d33ad1b87 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:41 user nova-compute[72998]:   <uuid>ffb74821-5eff-4099-8bb6-d35d33ad1b87</uuid>
Aug 17 08:14:41 user nova-compute[72998]:   <name>instance-00000005</name>
Aug 17 08:14:41 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:41 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:41 user nova-compute[72998]:   <metadata>
Aug 17 08:14:41 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:41 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1767592221</nova:name>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:40</nova:creationTime>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:41 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:41 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:user uuid="e09e792e114f4e39a78f5bc4f7c83279">tempest-VolumesAssistedSnapshotsTest-1422585177-project-member</nova:user>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:project uuid="b5a18b85c6664687aac505b5b72077b7">tempest-VolumesAssistedSnapshotsTest-1422585177</nova:project>
Aug 17 08:14:41 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:port uuid="adc18de6-340a-44b0-814b-f1c5345805f7">
Aug 17 08:14:41 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 08:14:41 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:41 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:41 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:41 user nova-compute[72998]:   </metadata>
Aug 17 08:14:41 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:41 user nova-compute[72998]:     <system>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="serial">ffb74821-5eff-4099-8bb6-d35d33ad1b87</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="uuid">ffb74821-5eff-4099-8bb6-d35d33ad1b87</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:41 user nova-compute[72998]:     </system>
Aug 17 08:14:41 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:41 user nova-compute[72998]:   <os>
Aug 17 08:14:41 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:41 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:41 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:41 user nova-compute[72998]:   </os>
Aug 17 08:14:41 user nova-compute[72998]:   <features>
Aug 17 08:14:41 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:41 user nova-compute[72998]:     <apic/>
Aug 17 08:14:41 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:41 user nova-compute[72998]:   </features>
Aug 17 08:14:41 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:41 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:41 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:41 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:41 user nova-compute[72998]:   </clock>
Aug 17 08:14:41 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:41 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:41 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:41 user nova-compute[72998]:   </cpu>
Aug 17 08:14:41 user nova-compute[72998]:   <devices>
Aug 17 08:14:41 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:41 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:41 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk"/>
Aug 17 08:14:41 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:14:41 user nova-compute[72998]:     </disk>
Aug 17 08:14:41 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:41 user nova-compute[72998]:       <mac address="fa:16:3e:1b:d7:33"/>
Aug 17 08:14:41 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:41 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:41 user nova-compute[72998]:       <target dev="tapadc18de6-34"/>
Aug 17 08:14:41 user nova-compute[72998]:     </interface>
Aug 17 08:14:41 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:41 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/console.log" append="off"/>
Aug 17 08:14:41 user nova-compute[72998]:     </serial>
Aug 17 08:14:41 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:41 user nova-compute[72998]:     <video>
Aug 17 08:14:41 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:41 user nova-compute[72998]:     </video>
Aug 17 08:14:41 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:41 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:41 user nova-compute[72998]:     </rng>
Aug 17 08:14:41 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:41 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:41 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:41 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:41 user nova-compute[72998]:   </devices>
Aug 17 08:14:41 user nova-compute[72998]: </domain>
Aug 17 08:14:41 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1767592221',display_name='tempest-VolumesAssistedSnapshotsTest-server-1767592221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1767592221',id=5,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL03JcvDTiyZtspb484FKd4yUO9MGouQBcvtg2oJL0koXTGKNyi5Pk/MSPDJTUOFn/l/37KtH3u7mYbMlLGVMtUU+7ZC6QHzq17LatOyZtY5/g0T22hnszzOuPBro5W8sw==',key_name='tempest-keypair-1579729383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5a18b85c6664687aac505b5b72077b7',ramdisk_id='',reservation_id='r-py3e3qko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1422585177',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1422585177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e09e792e114f4e39a78f5bc4f7c83279',uuid=ffb74821-5eff-4099-8bb6-d35d33ad1b87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Converting VIF {"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:d7:33,bridge_name='br-int',has_traffic_filtering=True,id=adc18de6-340a-44b0-814b-f1c5345805f7,network=Network(7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc18de6-34') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG os_vif [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:d7:33,bridge_name='br-int',has_traffic_filtering=True,id=adc18de6-340a-44b0-814b-f1c5345805f7,network=Network(7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc18de6-34') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadc18de6-34, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadc18de6-34, col_values=(('external_ids', {'iface-id': 'adc18de6-340a-44b0-814b-f1c5345805f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:d7:33', 'vm-uuid': 'ffb74821-5eff-4099-8bb6-d35d33ad1b87'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:41 user nova-compute[72998]: INFO os_vif [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:d7:33,bridge_name='br-int',has_traffic_filtering=True,id=adc18de6-340a-44b0-814b-f1c5345805f7,network=Network(7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc18de6-34')
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Updating instance_info_cache with network_info: [{"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.276s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Releasing lock "refresh_cache-a06900f6-a39f-422f-a7c3-c89e1574602b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Instance network_info: |[{"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Start _get_guest_xml network_info=[{"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:14:25Z,direct_url=<?>,disk_format='qcow2',id=17954092-02cf-4e7c-9f84-8786cce2ff8c,min_disk=0,min_ram=0,name='',owner='1081bc34b794435f943de8c33a7869c9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:14:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '17954092-02cf-4e7c-9f84-8786cce2ff8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] No VIF found with MAC fa:16:3e:1b:d7:33, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:41 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:41 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:14:25Z,direct_url=<?>,disk_format='qcow2',id=17954092-02cf-4e7c-9f84-8786cce2ff8c,min_disk=0,min_ram=0,name='',owner='1081bc34b794435f943de8c33a7869c9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:14:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1065149419',display_name='tempest-AttachSCSIVolumeTestJSON-server-1065149419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1065149419',id=7,image_ref='17954092-02cf-4e7c-9f84-8786cce2ff8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOysBq+K048C4j2VVqrIk5CH/b3KupNMLTo5FXvyR3pOhildZa/ugeNsN4gcF8Wa2gsfT2ney7uR7jVcgVG2Uu+T/Axo/l7AeWGmked+85R/t6C6xovoSrrRDSemJGWFkA==',key_name='tempest-keypair-890772771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='189a8d5df1724c5799dafc741f135973',ramdisk_id='',reservation_id='r-plzdhemg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17954092-02cf-4e7c-9f84-8786cce2ff8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-627924396',owner_user_name='tempest-AttachSCSIVolumeTestJSON-627924396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6bb04fc09a44f4984fcafe9a36a5697',uuid=a06900f6-a39f-422f-a7c3-c89e1574602b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Converting VIF {"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=10a46c87-9138-48a8-8228-2bf4501448b1,network=Network(cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a46c87-91') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lazy-loading 'pci_devices' on Instance uuid a06900f6-a39f-422f-a7c3-c89e1574602b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:41 user nova-compute[72998]:   <uuid>a06900f6-a39f-422f-a7c3-c89e1574602b</uuid>
Aug 17 08:14:41 user nova-compute[72998]:   <name>instance-00000007</name>
Aug 17 08:14:41 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:41 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:41 user nova-compute[72998]:   <metadata>
Aug 17 08:14:41 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:41 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1065149419</nova:name>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:41</nova:creationTime>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:41 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:41 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:user uuid="c6bb04fc09a44f4984fcafe9a36a5697">tempest-AttachSCSIVolumeTestJSON-627924396-project-member</nova:user>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:project uuid="189a8d5df1724c5799dafc741f135973">tempest-AttachSCSIVolumeTestJSON-627924396</nova:project>
Aug 17 08:14:41 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:root type="image" uuid="17954092-02cf-4e7c-9f84-8786cce2ff8c"/>
Aug 17 08:14:41 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:41 user nova-compute[72998]:         <nova:port uuid="10a46c87-9138-48a8-8228-2bf4501448b1">
Aug 17 08:14:41 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 08:14:41 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:41 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:41 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:41 user nova-compute[72998]:   </metadata>
Aug 17 08:14:41 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:41 user nova-compute[72998]:     <system>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="serial">a06900f6-a39f-422f-a7c3-c89e1574602b</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="uuid">a06900f6-a39f-422f-a7c3-c89e1574602b</entry>
Aug 17 08:14:41 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:41 user nova-compute[72998]:     </system>
Aug 17 08:14:41 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:41 user nova-compute[72998]:   <os>
Aug 17 08:14:41 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:41 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:41 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:41 user nova-compute[72998]:   </os>
Aug 17 08:14:41 user nova-compute[72998]:   <features>
Aug 17 08:14:41 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:41 user nova-compute[72998]:     <apic/>
Aug 17 08:14:41 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:41 user nova-compute[72998]:   </features>
Aug 17 08:14:41 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:41 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:41 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:41 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:41 user nova-compute[72998]:   </clock>
Aug 17 08:14:41 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:41 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:41 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:41 user nova-compute[72998]:   </cpu>
Aug 17 08:14:41 user nova-compute[72998]:   <devices>
Aug 17 08:14:41 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:41 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:41 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk"/>
Aug 17 08:14:41 user nova-compute[72998]:       <target dev="sda" bus="scsi"/>
Aug 17 08:14:41 user nova-compute[72998]:       <address type="drive" controller="0" unit="0"/>
Aug 17 08:14:41 user nova-compute[72998]:     </disk>
Aug 17 08:14:41 user nova-compute[72998]:     <disk type="file" device="cdrom">
Aug 17 08:14:41 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 08:14:41 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk.config"/>
Aug 17 08:14:41 user nova-compute[72998]:       <target dev="sdb" bus="scsi"/>
Aug 17 08:14:41 user nova-compute[72998]:       <address type="drive" controller="0" unit="1"/>
Aug 17 08:14:41 user nova-compute[72998]:     </disk>
Aug 17 08:14:41 user nova-compute[72998]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 17 08:14:41 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:41 user nova-compute[72998]:       <mac address="fa:16:3e:0d:94:99"/>
Aug 17 08:14:41 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:41 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:41 user nova-compute[72998]:       <target dev="tap10a46c87-91"/>
Aug 17 08:14:41 user nova-compute[72998]:     </interface>
Aug 17 08:14:41 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:41 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/console.log" append="off"/>
Aug 17 08:14:41 user nova-compute[72998]:     </serial>
Aug 17 08:14:41 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:41 user nova-compute[72998]:     <video>
Aug 17 08:14:41 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:41 user nova-compute[72998]:     </video>
Aug 17 08:14:41 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:41 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:41 user nova-compute[72998]:     </rng>
Aug 17 08:14:41 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:41 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:41 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:41 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:41 user nova-compute[72998]:   </devices>
Aug 17 08:14:41 user nova-compute[72998]: </domain>
Aug 17 08:14:41 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1065149419',display_name='tempest-AttachSCSIVolumeTestJSON-server-1065149419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1065149419',id=7,image_ref='17954092-02cf-4e7c-9f84-8786cce2ff8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOysBq+K048C4j2VVqrIk5CH/b3KupNMLTo5FXvyR3pOhildZa/ugeNsN4gcF8Wa2gsfT2ney7uR7jVcgVG2Uu+T/Axo/l7AeWGmked+85R/t6C6xovoSrrRDSemJGWFkA==',key_name='tempest-keypair-890772771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='189a8d5df1724c5799dafc741f135973',ramdisk_id='',reservation_id='r-plzdhemg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17954092-02cf-4e7c-9f84-8786cce2ff8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-627924396',owner_user_name='tempest-AttachSCSIVolumeTestJSON-627924396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6bb04fc09a44f4984fcafe9a36a5697',uuid=a06900f6-a39f-422f-a7c3-c89e1574602b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Converting VIF {"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=10a46c87-9138-48a8-8228-2bf4501448b1,network=Network(cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a46c87-91') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG os_vif [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=10a46c87-9138-48a8-8228-2bf4501448b1,network=Network(cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a46c87-91') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10a46c87-91, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10a46c87-91, col_values=(('external_ids', {'iface-id': '10a46c87-9138-48a8-8228-2bf4501448b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:94:99', 'vm-uuid': 'a06900f6-a39f-422f-a7c3-c89e1574602b'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:41 user nova-compute[72998]: INFO os_vif [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=10a46c87-9138-48a8-8228-2bf4501448b1,network=Network(cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a46c87-91')
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.287s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk 1073741824" returned: 0 in 0.061s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] No BDM found with device name sda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] No VIF found with MAC fa:16:3e:0d:94:99, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:41 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Using config drive
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.269s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Successfully updated port: 91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquiring lock "refresh_cache-1178b496-7709-411f-a789-766d6eea004b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquired lock "refresh_cache-1178b496-7709-411f-a789-766d6eea004b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-d6814047-6eb8-4dde-8d11-b6c649035f1d req-822dc033-820a-4934-bdd9-49ac136f4268 service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received event network-changed-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-d6814047-6eb8-4dde-8d11-b6c649035f1d req-822dc033-820a-4934-bdd9-49ac136f4268 service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Refreshing instance network info cache due to event network-changed-91bb8838-cd5e-4692-ab34-5bccb072a0dc. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d6814047-6eb8-4dde-8d11-b6c649035f1d req-822dc033-820a-4934-bdd9-49ac136f4268 service nova] Acquiring lock "refresh_cache-1178b496-7709-411f-a789-766d6eea004b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Successfully created port: 76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Cannot resize image /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lazy-loading 'migration_context' on Instance uuid e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Ensure instance console log exists: /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG nova.network.neutron [req-00717feb-70df-488d-b26b-b23b3261782f req-29d8e98e-1482-43be-b33c-a99006138c25 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Updated VIF entry in instance network info cache for port adc18de6-340a-44b0-814b-f1c5345805f7. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG nova.network.neutron [req-00717feb-70df-488d-b26b-b23b3261782f req-29d8e98e-1482-43be-b33c-a99006138c25 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Updating instance_info_cache with network_info: [{"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-00717feb-70df-488d-b26b-b23b3261782f req-29d8e98e-1482-43be-b33c-a99006138c25 service nova] Releasing lock "refresh_cache-ffb74821-5eff-4099-8bb6-d35d33ad1b87" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:42 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Creating config drive at /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk.config
Aug 17 08:14:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkm8s1pu0 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkm8s1pu0" returned: 0 in 0.094s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Successfully created port: fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.network.neutron [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Updating instance_info_cache with network_info: [{"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Releasing lock "refresh_cache-1178b496-7709-411f-a789-766d6eea004b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Instance network_info: |[{"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d6814047-6eb8-4dde-8d11-b6c649035f1d req-822dc033-820a-4934-bdd9-49ac136f4268 service nova] Acquired lock "refresh_cache-1178b496-7709-411f-a789-766d6eea004b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-d6814047-6eb8-4dde-8d11-b6c649035f1d req-822dc033-820a-4934-bdd9-49ac136f4268 service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Refreshing network info cache for port 91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Start _get_guest_xml network_info=[{"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-982697197',display_name='tempest-VolumesActionsTest-instance-982697197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-982697197',id=6,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35d7aae117654398996e22cb255c8584',ramdisk_id='',reservation_id='r-a6urf7q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1504737873',owner_user_name='tempest-VolumesActionsTest-1504737873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:33Z,user_data=None,user_id='f3db31250e9e4e71853b077aef0af43d',uuid=1178b496-7709-411f-a789-766d6eea004b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Converting VIF {"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:91:aa,bridge_name='br-int',has_traffic_filtering=True,id=91bb8838-cd5e-4692-ab34-5bccb072a0dc,network=Network(a2350d59-07c2-443d-9603-dd1807ac62d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bb8838-cd') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.objects.instance [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lazy-loading 'pci_devices' on Instance uuid 1178b496-7709-411f-a789-766d6eea004b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:43 user nova-compute[72998]:   <uuid>1178b496-7709-411f-a789-766d6eea004b</uuid>
Aug 17 08:14:43 user nova-compute[72998]:   <name>instance-00000006</name>
Aug 17 08:14:43 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:43 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:43 user nova-compute[72998]:   <metadata>
Aug 17 08:14:43 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:43 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:43 user nova-compute[72998]:       <nova:name>tempest-VolumesActionsTest-instance-982697197</nova:name>
Aug 17 08:14:43 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:43</nova:creationTime>
Aug 17 08:14:43 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:43 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:43 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:43 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:43 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:43 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:43 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:43 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:43 user nova-compute[72998]:         <nova:user uuid="f3db31250e9e4e71853b077aef0af43d">tempest-VolumesActionsTest-1504737873-project-member</nova:user>
Aug 17 08:14:43 user nova-compute[72998]:         <nova:project uuid="35d7aae117654398996e22cb255c8584">tempest-VolumesActionsTest-1504737873</nova:project>
Aug 17 08:14:43 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:43 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:14:43 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:43 user nova-compute[72998]:         <nova:port uuid="91bb8838-cd5e-4692-ab34-5bccb072a0dc">
Aug 17 08:14:43 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 08:14:43 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:43 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:43 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:43 user nova-compute[72998]:   </metadata>
Aug 17 08:14:43 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:43 user nova-compute[72998]:     <system>
Aug 17 08:14:43 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:43 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:43 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:43 user nova-compute[72998]:       <entry name="serial">1178b496-7709-411f-a789-766d6eea004b</entry>
Aug 17 08:14:43 user nova-compute[72998]:       <entry name="uuid">1178b496-7709-411f-a789-766d6eea004b</entry>
Aug 17 08:14:43 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:43 user nova-compute[72998]:     </system>
Aug 17 08:14:43 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:43 user nova-compute[72998]:   <os>
Aug 17 08:14:43 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:43 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:43 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:43 user nova-compute[72998]:   </os>
Aug 17 08:14:43 user nova-compute[72998]:   <features>
Aug 17 08:14:43 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:43 user nova-compute[72998]:     <apic/>
Aug 17 08:14:43 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:43 user nova-compute[72998]:   </features>
Aug 17 08:14:43 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:43 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:43 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:43 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:43 user nova-compute[72998]:   </clock>
Aug 17 08:14:43 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:43 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:43 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:43 user nova-compute[72998]:   </cpu>
Aug 17 08:14:43 user nova-compute[72998]:   <devices>
Aug 17 08:14:43 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:43 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:43 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk"/>
Aug 17 08:14:43 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:14:43 user nova-compute[72998]:     </disk>
Aug 17 08:14:43 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:43 user nova-compute[72998]:       <mac address="fa:16:3e:fa:91:aa"/>
Aug 17 08:14:43 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:43 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:43 user nova-compute[72998]:       <target dev="tap91bb8838-cd"/>
Aug 17 08:14:43 user nova-compute[72998]:     </interface>
Aug 17 08:14:43 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:43 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/console.log" append="off"/>
Aug 17 08:14:43 user nova-compute[72998]:     </serial>
Aug 17 08:14:43 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:43 user nova-compute[72998]:     <video>
Aug 17 08:14:43 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:43 user nova-compute[72998]:     </video>
Aug 17 08:14:43 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:43 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:43 user nova-compute[72998]:     </rng>
Aug 17 08:14:43 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:43 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:43 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:43 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:43 user nova-compute[72998]:   </devices>
Aug 17 08:14:43 user nova-compute[72998]: </domain>
Aug 17 08:14:43 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-982697197',display_name='tempest-VolumesActionsTest-instance-982697197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-982697197',id=6,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35d7aae117654398996e22cb255c8584',ramdisk_id='',reservation_id='r-a6urf7q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1504737873',owner_user_name='tempest-VolumesActionsTest-1504737873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:33Z,user_data=None,user_id='f3db31250e9e4e71853b077aef0af43d',uuid=1178b496-7709-411f-a789-766d6eea004b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Converting VIF {"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:91:aa,bridge_name='br-int',has_traffic_filtering=True,id=91bb8838-cd5e-4692-ab34-5bccb072a0dc,network=Network(a2350d59-07c2-443d-9603-dd1807ac62d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bb8838-cd') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG os_vif [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:91:aa,bridge_name='br-int',has_traffic_filtering=True,id=91bb8838-cd5e-4692-ab34-5bccb072a0dc,network=Network(a2350d59-07c2-443d-9603-dd1807ac62d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bb8838-cd') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91bb8838-cd, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91bb8838-cd, col_values=(('external_ids', {'iface-id': '91bb8838-cd5e-4692-ab34-5bccb072a0dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:91:aa', 'vm-uuid': '1178b496-7709-411f-a789-766d6eea004b'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:43 user nova-compute[72998]: INFO os_vif [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:91:aa,bridge_name='br-int',has_traffic_filtering=True,id=91bb8838-cd5e-4692-ab34-5bccb072a0dc,network=Network(a2350d59-07c2-443d-9603-dd1807ac62d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bb8838-cd')
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] No VIF found with MAC fa:16:3e:fa:91:aa, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.network.neutron [req-d6814047-6eb8-4dde-8d11-b6c649035f1d req-822dc033-820a-4934-bdd9-49ac136f4268 service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Updated VIF entry in instance network info cache for port 91bb8838-cd5e-4692-ab34-5bccb072a0dc. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.network.neutron [req-d6814047-6eb8-4dde-8d11-b6c649035f1d req-822dc033-820a-4934-bdd9-49ac136f4268 service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Updating instance_info_cache with network_info: [{"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d6814047-6eb8-4dde-8d11-b6c649035f1d req-822dc033-820a-4934-bdd9-49ac136f4268 service nova] Releasing lock "refresh_cache-1178b496-7709-411f-a789-766d6eea004b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Successfully updated port: fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-5e3e3c8a-3ea7-42f6-af08-8e0ea4b8c4d4 req-c9155a97-9b32-415b-89d4-555a9bacab28 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received event network-changed-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-5e3e3c8a-3ea7-42f6-af08-8e0ea4b8c4d4 req-c9155a97-9b32-415b-89d4-555a9bacab28 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Refreshing instance network info cache due to event network-changed-fc117be3-a78c-4709-83d5-8f2ff3ecfe88. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5e3e3c8a-3ea7-42f6-af08-8e0ea4b8c4d4 req-c9155a97-9b32-415b-89d4-555a9bacab28 service nova] Acquiring lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5e3e3c8a-3ea7-42f6-af08-8e0ea4b8c4d4 req-c9155a97-9b32-415b-89d4-555a9bacab28 service nova] Acquired lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.network.neutron [req-5e3e3c8a-3ea7-42f6-af08-8e0ea4b8c4d4 req-c9155a97-9b32-415b-89d4-555a9bacab28 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Refreshing network info cache for port fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Successfully updated port: 76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquired lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.network.neutron [req-5e3e3c8a-3ea7-42f6-af08-8e0ea4b8c4d4 req-c9155a97-9b32-415b-89d4-555a9bacab28 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-bc8cb691-c5f0-4176-9e2b-049cfb131bc6 req-7e6c67ed-d143-42ad-9ce6-158eaca8d533 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-changed-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-bc8cb691-c5f0-4176-9e2b-049cfb131bc6 req-7e6c67ed-d143-42ad-9ce6-158eaca8d533 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Refreshing instance network info cache due to event network-changed-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bc8cb691-c5f0-4176-9e2b-049cfb131bc6 req-7e6c67ed-d143-42ad-9ce6-158eaca8d533 service nova] Acquiring lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.network.neutron [req-5e3e3c8a-3ea7-42f6-af08-8e0ea4b8c4d4 req-c9155a97-9b32-415b-89d4-555a9bacab28 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.network.neutron [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updating instance_info_cache with network_info: [{"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5e3e3c8a-3ea7-42f6-af08-8e0ea4b8c4d4 req-c9155a97-9b32-415b-89d4-555a9bacab28 service nova] Releasing lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquired lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Releasing lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Instance network_info: |[{"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bc8cb691-c5f0-4176-9e2b-049cfb131bc6 req-7e6c67ed-d143-42ad-9ce6-158eaca8d533 service nova] Acquired lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.network.neutron [req-bc8cb691-c5f0-4176-9e2b-049cfb131bc6 req-7e6c67ed-d143-42ad-9ce6-158eaca8d533 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Refreshing network info cache for port 76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Start _get_guest_xml network_info=[{"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:45 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:45 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900252933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900252933',id=8,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVTnC3gnP971i31Ttky/4Xg/EnkXcozD7zi9pP8iuMWUahf+05KbIMa109iWM3ukXkgnqBJa6j0JfmxF37zj1tzySFuAQ4DGs1cYm513zaFxLSVFwigoX2hV94IwNMXxg==',key_name='tempest-keypair-1262423847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9985c560f34f4991b6cb938d8b6fcd57',ramdisk_id='',reservation_id='r-3vy0dn1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1304973980',owner_user_name='tempest-TaggedAttachmentsTest-1304973980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14c6925b804342b7bee762e57a0fe9a1',uuid=e087f5bf-889a-462d-a412-4a39e829f6ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converting VIF {"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e7:43,bridge_name='br-int',has_traffic_filtering=True,id=76ac8bc8-ccbc-42fd-8caa-5c01cad6148f,network=Network(b0cf5987-3599-4520-845d-4e2b2610068a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ac8bc8-cc') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.objects.instance [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lazy-loading 'pci_devices' on Instance uuid e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:45 user nova-compute[72998]:   <uuid>e087f5bf-889a-462d-a412-4a39e829f6ec</uuid>
Aug 17 08:14:45 user nova-compute[72998]:   <name>instance-00000008</name>
Aug 17 08:14:45 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:45 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:45 user nova-compute[72998]:   <metadata>
Aug 17 08:14:45 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:45 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:45 user nova-compute[72998]:       <nova:name>tempest-device-tagging-server-900252933</nova:name>
Aug 17 08:14:45 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:45</nova:creationTime>
Aug 17 08:14:45 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:45 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:45 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:45 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:45 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:45 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:45 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:45 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:45 user nova-compute[72998]:         <nova:user uuid="14c6925b804342b7bee762e57a0fe9a1">tempest-TaggedAttachmentsTest-1304973980-project-member</nova:user>
Aug 17 08:14:45 user nova-compute[72998]:         <nova:project uuid="9985c560f34f4991b6cb938d8b6fcd57">tempest-TaggedAttachmentsTest-1304973980</nova:project>
Aug 17 08:14:45 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:45 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:14:45 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:45 user nova-compute[72998]:         <nova:port uuid="76ac8bc8-ccbc-42fd-8caa-5c01cad6148f">
Aug 17 08:14:45 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:14:45 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:45 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:45 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:45 user nova-compute[72998]:   </metadata>
Aug 17 08:14:45 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:45 user nova-compute[72998]:     <system>
Aug 17 08:14:45 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:45 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:45 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:45 user nova-compute[72998]:       <entry name="serial">e087f5bf-889a-462d-a412-4a39e829f6ec</entry>
Aug 17 08:14:45 user nova-compute[72998]:       <entry name="uuid">e087f5bf-889a-462d-a412-4a39e829f6ec</entry>
Aug 17 08:14:45 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:45 user nova-compute[72998]:     </system>
Aug 17 08:14:45 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:45 user nova-compute[72998]:   <os>
Aug 17 08:14:45 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:45 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:45 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:45 user nova-compute[72998]:   </os>
Aug 17 08:14:45 user nova-compute[72998]:   <features>
Aug 17 08:14:45 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:45 user nova-compute[72998]:     <apic/>
Aug 17 08:14:45 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:45 user nova-compute[72998]:   </features>
Aug 17 08:14:45 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:45 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:45 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:45 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:45 user nova-compute[72998]:   </clock>
Aug 17 08:14:45 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:45 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:45 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:45 user nova-compute[72998]:   </cpu>
Aug 17 08:14:45 user nova-compute[72998]:   <devices>
Aug 17 08:14:45 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:45 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:45 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk"/>
Aug 17 08:14:45 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:14:45 user nova-compute[72998]:     </disk>
Aug 17 08:14:45 user nova-compute[72998]:     <disk type="file" device="cdrom">
Aug 17 08:14:45 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 08:14:45 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk.config"/>
Aug 17 08:14:45 user nova-compute[72998]:       <target dev="hda" bus="ide"/>
Aug 17 08:14:45 user nova-compute[72998]:     </disk>
Aug 17 08:14:45 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:45 user nova-compute[72998]:       <mac address="fa:16:3e:6c:e7:43"/>
Aug 17 08:14:45 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:45 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:45 user nova-compute[72998]:       <target dev="tap76ac8bc8-cc"/>
Aug 17 08:14:45 user nova-compute[72998]:     </interface>
Aug 17 08:14:45 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:45 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/console.log" append="off"/>
Aug 17 08:14:45 user nova-compute[72998]:     </serial>
Aug 17 08:14:45 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:45 user nova-compute[72998]:     <video>
Aug 17 08:14:45 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:45 user nova-compute[72998]:     </video>
Aug 17 08:14:45 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:45 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:45 user nova-compute[72998]:     </rng>
Aug 17 08:14:45 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:45 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:45 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:45 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:45 user nova-compute[72998]:   </devices>
Aug 17 08:14:45 user nova-compute[72998]: </domain>
Aug 17 08:14:45 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900252933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900252933',id=8,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVTnC3gnP971i31Ttky/4Xg/EnkXcozD7zi9pP8iuMWUahf+05KbIMa109iWM3ukXkgnqBJa6j0JfmxF37zj1tzySFuAQ4DGs1cYm513zaFxLSVFwigoX2hV94IwNMXxg==',key_name='tempest-keypair-1262423847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9985c560f34f4991b6cb938d8b6fcd57',ramdisk_id='',reservation_id='r-3vy0dn1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1304973980',owner_user_name='tempest-TaggedAttachmentsTest-1304973980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14c6925b804342b7bee762e57a0fe9a1',uuid=e087f5bf-889a-462d-a412-4a39e829f6ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converting VIF {"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e7:43,bridge_name='br-int',has_traffic_filtering=True,id=76ac8bc8-ccbc-42fd-8caa-5c01cad6148f,network=Network(b0cf5987-3599-4520-845d-4e2b2610068a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ac8bc8-cc') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG os_vif [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e7:43,bridge_name='br-int',has_traffic_filtering=True,id=76ac8bc8-ccbc-42fd-8caa-5c01cad6148f,network=Network(b0cf5987-3599-4520-845d-4e2b2610068a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ac8bc8-cc') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76ac8bc8-cc, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76ac8bc8-cc, col_values=(('external_ids', {'iface-id': '76ac8bc8-ccbc-42fd-8caa-5c01cad6148f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:e7:43', 'vm-uuid': 'e087f5bf-889a-462d-a412-4a39e829f6ec'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:45 user nova-compute[72998]: INFO os_vif [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:e7:43,bridge_name='br-int',has_traffic_filtering=True,id=76ac8bc8-ccbc-42fd-8caa-5c01cad6148f,network=Network(b0cf5987-3599-4520-845d-4e2b2610068a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ac8bc8-cc')
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] No BDM found with device name hda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] No VIF found with MAC fa:16:3e:6c:e7:43, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:45 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Using config drive
Aug 17 08:14:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-bc8cb691-c5f0-4176-9e2b-049cfb131bc6 req-7e6c67ed-d143-42ad-9ce6-158eaca8d533 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updated VIF entry in instance network info cache for port 76ac8bc8-ccbc-42fd-8caa-5c01cad6148f. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-bc8cb691-c5f0-4176-9e2b-049cfb131bc6 req-7e6c67ed-d143-42ad-9ce6-158eaca8d533 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updating instance_info_cache with network_info: [{"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Creating config drive at /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk.config
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphxpbf28g {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bc8cb691-c5f0-4176-9e2b-049cfb131bc6 req-7e6c67ed-d143-42ad-9ce6-158eaca8d533 service nova] Releasing lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphxpbf28g" returned: 0 in 0.065s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-b67fe5bc-5d25-4d9c-b726-ca14d1b91240 req-6ce88b09-2215-412b-9df3-57277b1b2988 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received event network-vif-plugged-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b67fe5bc-5d25-4d9c-b726-ca14d1b91240 req-6ce88b09-2215-412b-9df3-57277b1b2988 service nova] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b67fe5bc-5d25-4d9c-b726-ca14d1b91240 req-6ce88b09-2215-412b-9df3-57277b1b2988 service nova] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b67fe5bc-5d25-4d9c-b726-ca14d1b91240 req-6ce88b09-2215-412b-9df3-57277b1b2988 service nova] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-b67fe5bc-5d25-4d9c-b726-ca14d1b91240 req-6ce88b09-2215-412b-9df3-57277b1b2988 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] No waiting events found dispatching network-vif-plugged-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:46 user nova-compute[72998]: WARNING nova.compute.manager [req-b67fe5bc-5d25-4d9c-b726-ca14d1b91240 req-6ce88b09-2215-412b-9df3-57277b1b2988 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received unexpected event network-vif-plugged-10a46c87-9138-48a8-8228-2bf4501448b1 for instance with vm_state building and task_state spawning.
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Updating instance_info_cache with network_info: [{"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Releasing lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Instance network_info: |[{"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Start _get_guest_xml network_info=[{"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:46 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:46 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-191884981',display_name='tempest-VolumesAdminNegativeTest-server-191884981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-191884981',id=9,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc8gELbgZ7FG/6kW6Zh20T0v0wzhLNwt0EmjAU+PgOk6ae9Y70vwc40f93TUA8I3fQQS1YA6sWn9eSA5OE9ywJwCqbpgypKNV1p829qjwqzrNDlNTML61Y/3GyRo65TfA==',key_name='tempest-keypair-195077305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b23b971dd054295802333297815ee12',ramdisk_id='',reservation_id='r-x8w4jehz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1447835405',owner_user_name='tempest-VolumesAdminNegativeTest-1447835405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e444ed21ebed454cb5c30943a5725f6b',uuid=e1f08a74-5ec5-4108-b17c-d8cc9380e5a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converting VIF {"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ef:ff,bridge_name='br-int',has_traffic_filtering=True,id=fc117be3-a78c-4709-83d5-8f2ff3ecfe88,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc117be3-a7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lazy-loading 'pci_devices' on Instance uuid e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:46 user nova-compute[72998]:   <uuid>e1f08a74-5ec5-4108-b17c-d8cc9380e5a2</uuid>
Aug 17 08:14:46 user nova-compute[72998]:   <name>instance-00000009</name>
Aug 17 08:14:46 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:46 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:46 user nova-compute[72998]:   <metadata>
Aug 17 08:14:46 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:46 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:46 user nova-compute[72998]:       <nova:name>tempest-VolumesAdminNegativeTest-server-191884981</nova:name>
Aug 17 08:14:46 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:46</nova:creationTime>
Aug 17 08:14:46 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:46 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:46 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:46 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:46 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:46 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:46 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:46 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:46 user nova-compute[72998]:         <nova:user uuid="e444ed21ebed454cb5c30943a5725f6b">tempest-VolumesAdminNegativeTest-1447835405-project-member</nova:user>
Aug 17 08:14:46 user nova-compute[72998]:         <nova:project uuid="0b23b971dd054295802333297815ee12">tempest-VolumesAdminNegativeTest-1447835405</nova:project>
Aug 17 08:14:46 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:46 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:14:46 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:46 user nova-compute[72998]:         <nova:port uuid="fc117be3-a78c-4709-83d5-8f2ff3ecfe88">
Aug 17 08:14:46 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 08:14:46 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:46 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:46 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:46 user nova-compute[72998]:   </metadata>
Aug 17 08:14:46 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:46 user nova-compute[72998]:     <system>
Aug 17 08:14:46 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:46 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:46 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:46 user nova-compute[72998]:       <entry name="serial">e1f08a74-5ec5-4108-b17c-d8cc9380e5a2</entry>
Aug 17 08:14:46 user nova-compute[72998]:       <entry name="uuid">e1f08a74-5ec5-4108-b17c-d8cc9380e5a2</entry>
Aug 17 08:14:46 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:46 user nova-compute[72998]:     </system>
Aug 17 08:14:46 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:46 user nova-compute[72998]:   <os>
Aug 17 08:14:46 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:46 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:46 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:46 user nova-compute[72998]:   </os>
Aug 17 08:14:46 user nova-compute[72998]:   <features>
Aug 17 08:14:46 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:46 user nova-compute[72998]:     <apic/>
Aug 17 08:14:46 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:46 user nova-compute[72998]:   </features>
Aug 17 08:14:46 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:46 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:46 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:46 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:46 user nova-compute[72998]:   </clock>
Aug 17 08:14:46 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:46 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:46 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:46 user nova-compute[72998]:   </cpu>
Aug 17 08:14:46 user nova-compute[72998]:   <devices>
Aug 17 08:14:46 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:46 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:46 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk"/>
Aug 17 08:14:46 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:14:46 user nova-compute[72998]:     </disk>
Aug 17 08:14:46 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:46 user nova-compute[72998]:       <mac address="fa:16:3e:1d:ef:ff"/>
Aug 17 08:14:46 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:46 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:46 user nova-compute[72998]:       <target dev="tapfc117be3-a7"/>
Aug 17 08:14:46 user nova-compute[72998]:     </interface>
Aug 17 08:14:46 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:46 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/console.log" append="off"/>
Aug 17 08:14:46 user nova-compute[72998]:     </serial>
Aug 17 08:14:46 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:46 user nova-compute[72998]:     <video>
Aug 17 08:14:46 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:46 user nova-compute[72998]:     </video>
Aug 17 08:14:46 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:46 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:46 user nova-compute[72998]:     </rng>
Aug 17 08:14:46 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:46 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:46 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:46 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:46 user nova-compute[72998]:   </devices>
Aug 17 08:14:46 user nova-compute[72998]: </domain>
Aug 17 08:14:46 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-191884981',display_name='tempest-VolumesAdminNegativeTest-server-191884981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-191884981',id=9,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc8gELbgZ7FG/6kW6Zh20T0v0wzhLNwt0EmjAU+PgOk6ae9Y70vwc40f93TUA8I3fQQS1YA6sWn9eSA5OE9ywJwCqbpgypKNV1p829qjwqzrNDlNTML61Y/3GyRo65TfA==',key_name='tempest-keypair-195077305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b23b971dd054295802333297815ee12',ramdisk_id='',reservation_id='r-x8w4jehz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1447835405',owner_user_name='tempest-VolumesAdminNegativeTest-1447835405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e444ed21ebed454cb5c30943a5725f6b',uuid=e1f08a74-5ec5-4108-b17c-d8cc9380e5a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converting VIF {"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ef:ff,bridge_name='br-int',has_traffic_filtering=True,id=fc117be3-a78c-4709-83d5-8f2ff3ecfe88,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc117be3-a7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG os_vif [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ef:ff,bridge_name='br-int',has_traffic_filtering=True,id=fc117be3-a78c-4709-83d5-8f2ff3ecfe88,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc117be3-a7') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc117be3-a7, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc117be3-a7, col_values=(('external_ids', {'iface-id': 'fc117be3-a78c-4709-83d5-8f2ff3ecfe88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:ef:ff', 'vm-uuid': 'e1f08a74-5ec5-4108-b17c-d8cc9380e5a2'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:14:46 user nova-compute[72998]: INFO nova.compute.claims [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Claim successful on node user
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:46 user nova-compute[72998]: INFO os_vif [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ef:ff,bridge_name='br-int',has_traffic_filtering=True,id=fc117be3-a78c-4709-83d5-8f2ff3ecfe88,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc117be3-a7')
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] No VIF found with MAC fa:16:3e:1d:ef:ff, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-b663ffba-14e7-44c2-a3ac-93c3ad90d1b1 req-0350b6e2-655f-4800-bf84-8a66ea5b76f2 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received event network-vif-plugged-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b663ffba-14e7-44c2-a3ac-93c3ad90d1b1 req-0350b6e2-655f-4800-bf84-8a66ea5b76f2 service nova] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b663ffba-14e7-44c2-a3ac-93c3ad90d1b1 req-0350b6e2-655f-4800-bf84-8a66ea5b76f2 service nova] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b663ffba-14e7-44c2-a3ac-93c3ad90d1b1 req-0350b6e2-655f-4800-bf84-8a66ea5b76f2 service nova] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-b663ffba-14e7-44c2-a3ac-93c3ad90d1b1 req-0350b6e2-655f-4800-bf84-8a66ea5b76f2 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] No waiting events found dispatching network-vif-plugged-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:48 user nova-compute[72998]: WARNING nova.compute.manager [req-b663ffba-14e7-44c2-a3ac-93c3ad90d1b1 req-0350b6e2-655f-4800-bf84-8a66ea5b76f2 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received unexpected event network-vif-plugged-10a46c87-9138-48a8-8228-2bf4501448b1 for instance with vm_state building and task_state spawning.
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260089.136088, ffb74821-5eff-4099-8bb6-d35d33ad1b87 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] VM Resumed (Lifecycle Event)
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Instance spawned successfully.
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.450s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:14:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260089.137494, ffb74821-5eff-4099-8bb6-d35d33ad1b87 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] VM Started (Lifecycle Event)
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:14:49 user nova-compute[72998]: INFO nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Took 19.66 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:14:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:49 user nova-compute[72998]: INFO nova.compute.manager [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Took 21.32 seconds to build instance.
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5994971f-a4b2-4f22-9288-05939dc62f97 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.550s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.policy [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03ba73641461482f9a108848958eaf85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af73da99c7d042268ba6235903b69dbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:14:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Creating image(s)
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "/opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "/opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.231s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.214s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk 1073741824" returned: 0 in 0.065s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.236s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Cannot resize image /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.objects.instance [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lazy-loading 'migration_context' on Instance uuid c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Ensure instance console log exists: /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received event network-vif-plugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] No waiting events found dispatching network-vif-plugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:50 user nova-compute[72998]: WARNING nova.compute.manager [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received unexpected event network-vif-plugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 for instance with vm_state building and task_state spawning.
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received event network-vif-plugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] No waiting events found dispatching network-vif-plugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:50 user nova-compute[72998]: WARNING nova.compute.manager [req-c4bce868-08c6-474e-84db-2f3a2cba2906 req-56371675-3ae2-43ea-8d3f-63c01be14b23 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received unexpected event network-vif-plugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 for instance with vm_state building and task_state spawning.
Aug 17 08:14:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Successfully created port: a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260091.6303596, 1178b496-7709-411f-a789-766d6eea004b => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:51 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 1178b496-7709-411f-a789-766d6eea004b] VM Resumed (Lifecycle Event)
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:51 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 1178b496-7709-411f-a789-766d6eea004b] Instance spawned successfully.
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 1178b496-7709-411f-a789-766d6eea004b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:51 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Instance spawned successfully.
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 1178b496-7709-411f-a789-766d6eea004b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 1178b496-7709-411f-a789-766d6eea004b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260091.6357174, 1178b496-7709-411f-a789-766d6eea004b => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:51 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 1178b496-7709-411f-a789-766d6eea004b] VM Started (Lifecycle Event)
Aug 17 08:14:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 1178b496-7709-411f-a789-766d6eea004b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 1178b496-7709-411f-a789-766d6eea004b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:51 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 1178b496-7709-411f-a789-766d6eea004b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260091.6463695, a06900f6-a39f-422f-a7c3-c89e1574602b => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:51 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] VM Resumed (Lifecycle Event)
Aug 17 08:14:51 user nova-compute[72998]: INFO nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Took 18.42 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:51 user nova-compute[72998]: INFO nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Took 15.56 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:52 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260091.657747, a06900f6-a39f-422f-a7c3-c89e1574602b => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:52 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] VM Started (Lifecycle Event)
Aug 17 08:14:52 user nova-compute[72998]: INFO nova.compute.manager [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Took 20.09 seconds to build instance.
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-20e49f34-a67c-48d2-a4d8-bf340731af90 tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "1178b496-7709-411f-a789-766d6eea004b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.369s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:52 user nova-compute[72998]: INFO nova.compute.manager [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Took 16.62 seconds to build instance.
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7306fccd-bb8d-481b-bec8-862398818c8e tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.804s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-ac6a0964-aed5-4676-a682-a858ff2601d5 req-c409961f-6792-4419-87a7-8406fad4471c service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received event network-vif-plugged-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ac6a0964-aed5-4676-a682-a858ff2601d5 req-c409961f-6792-4419-87a7-8406fad4471c service nova] Acquiring lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ac6a0964-aed5-4676-a682-a858ff2601d5 req-c409961f-6792-4419-87a7-8406fad4471c service nova] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ac6a0964-aed5-4676-a682-a858ff2601d5 req-c409961f-6792-4419-87a7-8406fad4471c service nova] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-ac6a0964-aed5-4676-a682-a858ff2601d5 req-c409961f-6792-4419-87a7-8406fad4471c service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] No waiting events found dispatching network-vif-plugged-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:52 user nova-compute[72998]: WARNING nova.compute.manager [req-ac6a0964-aed5-4676-a682-a858ff2601d5 req-c409961f-6792-4419-87a7-8406fad4471c service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received unexpected event network-vif-plugged-b9139967-deff-45c2-84d5-6234f414bcd4 for instance with vm_state active and task_state None.
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Successfully updated port: a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "refresh_cache-c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquired lock "refresh_cache-c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-516e5571-18b8-4eba-a06d-ed6562c143a7 req-c1fa3503-419f-4ff6-8d06-ead260011126 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-516e5571-18b8-4eba-a06d-ed6562c143a7 req-c1fa3503-419f-4ff6-8d06-ead260011126 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-516e5571-18b8-4eba-a06d-ed6562c143a7 req-c1fa3503-419f-4ff6-8d06-ead260011126 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-516e5571-18b8-4eba-a06d-ed6562c143a7 req-c1fa3503-419f-4ff6-8d06-ead260011126 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-516e5571-18b8-4eba-a06d-ed6562c143a7 req-c1fa3503-419f-4ff6-8d06-ead260011126 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:52 user nova-compute[72998]: WARNING nova.compute.manager [req-516e5571-18b8-4eba-a06d-ed6562c143a7 req-c1fa3503-419f-4ff6-8d06-ead260011126 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f for instance with vm_state building and task_state spawning.
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 08:14:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260093.1198776, e087f5bf-889a-462d-a412-4a39e829f6ec => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] VM Resumed (Lifecycle Event)
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Instance spawned successfully.
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260093.1200318, e087f5bf-889a-462d-a412-4a39e829f6ec => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] VM Started (Lifecycle Event)
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Took 13.68 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260093.42566, e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] VM Resumed (Lifecycle Event)
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Instance spawned successfully.
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260093.426756, e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] VM Started (Lifecycle Event)
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Took 15.68 seconds to build instance.
Aug 17 08:14:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55ddc09a-64f6-40ef-a7c8-303bec32d12a tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.048s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:53 user nova-compute[72998]: INFO nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Took 13.08 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:54 user nova-compute[72998]: INFO nova.compute.manager [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Took 14.91 seconds to build instance.
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Updating instance_info_cache with network_info: [{"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d33ce358-b987-46f1-bc19-1235d9102910 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.163s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Releasing lock "refresh_cache-c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Instance network_info: |[{"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Start _get_guest_xml network_info=[{"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:14:54 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:54 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1706195134',display_name='tempest-TestVolumeSwap-server-1706195134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1706195134',id=10,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSYjrjF+auphKaTkK/IDWDfl9supA+Yf4yKeRWCXgDIbyVDWDpgynVL4QZScWX1w5q3dbJiRF0IerBxQydtqTuiBmsNmhlu1zc/nkQDg7W9ZHqQ7H5ko+9q9pEEhvzsYQ==',key_name='tempest-keypair-475592770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af73da99c7d042268ba6235903b69dbe',ramdisk_id='',reservation_id='r-dqsnjlp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-697446545',owner_user_name='tempest-TestVolumeSwap-697446545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ba73641461482f9a108848958eaf85',uuid=c3d1e35d-0cec-451b-b0b8-c51fbfd78c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Converting VIF {"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:50:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9,network=Network(518ecfbd-7567-4823-8dd3-8ab34acc7021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ba726-b4') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.objects.instance [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lazy-loading 'pci_devices' on Instance uuid c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:14:54 user nova-compute[72998]:   <uuid>c3d1e35d-0cec-451b-b0b8-c51fbfd78c37</uuid>
Aug 17 08:14:54 user nova-compute[72998]:   <name>instance-0000000a</name>
Aug 17 08:14:54 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:14:54 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:14:54 user nova-compute[72998]:   <metadata>
Aug 17 08:14:54 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:14:54 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:14:54 user nova-compute[72998]:       <nova:name>tempest-TestVolumeSwap-server-1706195134</nova:name>
Aug 17 08:14:54 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:14:54</nova:creationTime>
Aug 17 08:14:54 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:14:54 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:14:54 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:14:54 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:14:54 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:14:54 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:14:54 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:14:54 user nova-compute[72998]:       <nova:owner>
Aug 17 08:14:54 user nova-compute[72998]:         <nova:user uuid="03ba73641461482f9a108848958eaf85">tempest-TestVolumeSwap-697446545-project-member</nova:user>
Aug 17 08:14:54 user nova-compute[72998]:         <nova:project uuid="af73da99c7d042268ba6235903b69dbe">tempest-TestVolumeSwap-697446545</nova:project>
Aug 17 08:14:54 user nova-compute[72998]:       </nova:owner>
Aug 17 08:14:54 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:14:54 user nova-compute[72998]:       <nova:ports>
Aug 17 08:14:54 user nova-compute[72998]:         <nova:port uuid="a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9">
Aug 17 08:14:54 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 08:14:54 user nova-compute[72998]:         </nova:port>
Aug 17 08:14:54 user nova-compute[72998]:       </nova:ports>
Aug 17 08:14:54 user nova-compute[72998]:     </nova:instance>
Aug 17 08:14:54 user nova-compute[72998]:   </metadata>
Aug 17 08:14:54 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:14:54 user nova-compute[72998]:     <system>
Aug 17 08:14:54 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:14:54 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:14:54 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:14:54 user nova-compute[72998]:       <entry name="serial">c3d1e35d-0cec-451b-b0b8-c51fbfd78c37</entry>
Aug 17 08:14:54 user nova-compute[72998]:       <entry name="uuid">c3d1e35d-0cec-451b-b0b8-c51fbfd78c37</entry>
Aug 17 08:14:54 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:14:54 user nova-compute[72998]:     </system>
Aug 17 08:14:54 user nova-compute[72998]:   </sysinfo>
Aug 17 08:14:54 user nova-compute[72998]:   <os>
Aug 17 08:14:54 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:14:54 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:14:54 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:14:54 user nova-compute[72998]:   </os>
Aug 17 08:14:54 user nova-compute[72998]:   <features>
Aug 17 08:14:54 user nova-compute[72998]:     <acpi/>
Aug 17 08:14:54 user nova-compute[72998]:     <apic/>
Aug 17 08:14:54 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:14:54 user nova-compute[72998]:   </features>
Aug 17 08:14:54 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:14:54 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:14:54 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:14:54 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:14:54 user nova-compute[72998]:   </clock>
Aug 17 08:14:54 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:14:54 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:14:54 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:14:54 user nova-compute[72998]:   </cpu>
Aug 17 08:14:54 user nova-compute[72998]:   <devices>
Aug 17 08:14:54 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:14:54 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:14:54 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk"/>
Aug 17 08:14:54 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:14:54 user nova-compute[72998]:     </disk>
Aug 17 08:14:54 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:14:54 user nova-compute[72998]:       <mac address="fa:16:3e:25:50:ea"/>
Aug 17 08:14:54 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:54 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:14:54 user nova-compute[72998]:       <target dev="tapa56ba726-b4"/>
Aug 17 08:14:54 user nova-compute[72998]:     </interface>
Aug 17 08:14:54 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:14:54 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/console.log" append="off"/>
Aug 17 08:14:54 user nova-compute[72998]:     </serial>
Aug 17 08:14:54 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:14:54 user nova-compute[72998]:     <video>
Aug 17 08:14:54 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:14:54 user nova-compute[72998]:     </video>
Aug 17 08:14:54 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:14:54 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:14:54 user nova-compute[72998]:     </rng>
Aug 17 08:14:54 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:14:54 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:14:54 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:14:54 user nova-compute[72998]:     </memballoon>
Aug 17 08:14:54 user nova-compute[72998]:   </devices>
Aug 17 08:14:54 user nova-compute[72998]: </domain>
Aug 17 08:14:54 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1706195134',display_name='tempest-TestVolumeSwap-server-1706195134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1706195134',id=10,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSYjrjF+auphKaTkK/IDWDfl9supA+Yf4yKeRWCXgDIbyVDWDpgynVL4QZScWX1w5q3dbJiRF0IerBxQydtqTuiBmsNmhlu1zc/nkQDg7W9ZHqQ7H5ko+9q9pEEhvzsYQ==',key_name='tempest-keypair-475592770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af73da99c7d042268ba6235903b69dbe',ramdisk_id='',reservation_id='r-dqsnjlp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-697446545',owner_user_name='tempest-TestVolumeSwap-697446545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ba73641461482f9a108848958eaf85',uuid=c3d1e35d-0cec-451b-b0b8-c51fbfd78c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Converting VIF {"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:50:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9,network=Network(518ecfbd-7567-4823-8dd3-8ab34acc7021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ba726-b4') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG os_vif [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:50:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9,network=Network(518ecfbd-7567-4823-8dd3-8ab34acc7021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ba726-b4') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa56ba726-b4, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa56ba726-b4, col_values=(('external_ids', {'iface-id': 'a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:50:ea', 'vm-uuid': 'c3d1e35d-0cec-451b-b0b8-c51fbfd78c37'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:54 user nova-compute[72998]: INFO os_vif [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:50:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9,network=Network(518ecfbd-7567-4823-8dd3-8ab34acc7021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ba726-b4')
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] No VIF found with MAC fa:16:3e:25:50:ea, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received event network-changed-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Refreshing instance network info cache due to event network-changed-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Acquiring lock "refresh_cache-c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Acquired lock "refresh_cache-c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Refreshing network info cache for port a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-63b559c1-54ed-4810-bb19-0d46c3cd849c req-aefb28f0-eb49-4a7e-a4bd-2c535a63bd35 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63b559c1-54ed-4810-bb19-0d46c3cd849c req-aefb28f0-eb49-4a7e-a4bd-2c535a63bd35 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63b559c1-54ed-4810-bb19-0d46c3cd849c req-aefb28f0-eb49-4a7e-a4bd-2c535a63bd35 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63b559c1-54ed-4810-bb19-0d46c3cd849c req-aefb28f0-eb49-4a7e-a4bd-2c535a63bd35 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-63b559c1-54ed-4810-bb19-0d46c3cd849c req-aefb28f0-eb49-4a7e-a4bd-2c535a63bd35 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:54 user nova-compute[72998]: WARNING nova.compute.manager [req-63b559c1-54ed-4810-bb19-0d46c3cd849c req-aefb28f0-eb49-4a7e-a4bd-2c535a63bd35 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f for instance with vm_state active and task_state None.
Aug 17 08:14:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Updated VIF entry in instance network info cache for port a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Updating instance_info_cache with network_info: [{"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Releasing lock "refresh_cache-c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received event network-vif-plugged-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Acquiring lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] No waiting events found dispatching network-vif-plugged-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:56 user nova-compute[72998]: WARNING nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received unexpected event network-vif-plugged-b9139967-deff-45c2-84d5-6234f414bcd4 for instance with vm_state active and task_state None.
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received event network-vif-plugged-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] No waiting events found dispatching network-vif-plugged-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:56 user nova-compute[72998]: WARNING nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received unexpected event network-vif-plugged-adc18de6-340a-44b0-814b-f1c5345805f7 for instance with vm_state active and task_state None.
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received event network-vif-plugged-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] No waiting events found dispatching network-vif-plugged-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:56 user nova-compute[72998]: WARNING nova.compute.manager [req-bdb0c79f-2d86-40d3-a109-694c3629a8b6 req-965d69d4-6e54-4108-b068-ea6d24eb549a service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received unexpected event network-vif-plugged-adc18de6-340a-44b0-814b-f1c5345805f7 for instance with vm_state active and task_state None.
Aug 17 08:14:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received event network-vif-plugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] Acquiring lock "1178b496-7709-411f-a789-766d6eea004b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] Lock "1178b496-7709-411f-a789-766d6eea004b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] Lock "1178b496-7709-411f-a789-766d6eea004b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] No waiting events found dispatching network-vif-plugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:56 user nova-compute[72998]: WARNING nova.compute.manager [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received unexpected event network-vif-plugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc for instance with vm_state active and task_state None.
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received event network-vif-plugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] Acquiring lock "1178b496-7709-411f-a789-766d6eea004b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] Lock "1178b496-7709-411f-a789-766d6eea004b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] Lock "1178b496-7709-411f-a789-766d6eea004b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] No waiting events found dispatching network-vif-plugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:56 user nova-compute[72998]: WARNING nova.compute.manager [req-44c081b7-2564-4b67-9c8e-260ff457035e req-97b14782-9ff1-4526-a4c5-21f45361e37d service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received unexpected event network-vif-plugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc for instance with vm_state active and task_state None.
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-b4847852-0c10-4f92-9ae0-231b5db6bdae req-751c6140-71a5-47dd-b7bc-3034f4142cb9 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received event network-vif-plugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b4847852-0c10-4f92-9ae0-231b5db6bdae req-751c6140-71a5-47dd-b7bc-3034f4142cb9 service nova] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b4847852-0c10-4f92-9ae0-231b5db6bdae req-751c6140-71a5-47dd-b7bc-3034f4142cb9 service nova] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b4847852-0c10-4f92-9ae0-231b5db6bdae req-751c6140-71a5-47dd-b7bc-3034f4142cb9 service nova] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-b4847852-0c10-4f92-9ae0-231b5db6bdae req-751c6140-71a5-47dd-b7bc-3034f4142cb9 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] No waiting events found dispatching network-vif-plugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:56 user nova-compute[72998]: WARNING nova.compute.manager [req-b4847852-0c10-4f92-9ae0-231b5db6bdae req-751c6140-71a5-47dd-b7bc-3034f4142cb9 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received unexpected event network-vif-plugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 for instance with vm_state building and task_state spawning.
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:14:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:14:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:57 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:14:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-dfc107d3-801f-4e2c-afbc-5a77c2bf629a req-f08b68ec-8dee-456a-84a7-62cf32280597 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received event network-vif-plugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:14:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dfc107d3-801f-4e2c-afbc-5a77c2bf629a req-f08b68ec-8dee-456a-84a7-62cf32280597 service nova] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:14:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dfc107d3-801f-4e2c-afbc-5a77c2bf629a req-f08b68ec-8dee-456a-84a7-62cf32280597 service nova] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:14:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dfc107d3-801f-4e2c-afbc-5a77c2bf629a req-f08b68ec-8dee-456a-84a7-62cf32280597 service nova] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:14:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-dfc107d3-801f-4e2c-afbc-5a77c2bf629a req-f08b68ec-8dee-456a-84a7-62cf32280597 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] No waiting events found dispatching network-vif-plugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:14:58 user nova-compute[72998]: WARNING nova.compute.manager [req-dfc107d3-801f-4e2c-afbc-5a77c2bf629a req-f08b68ec-8dee-456a-84a7-62cf32280597 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received unexpected event network-vif-plugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 for instance with vm_state building and task_state spawning.
Aug 17 08:14:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260099.6498103, c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] VM Resumed (Lifecycle Event)
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:14:59 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Instance spawned successfully.
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:14:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260099.664668, c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:14:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] VM Started (Lifecycle Event)
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:14:59 user nova-compute[72998]: INFO nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Took 10.34 seconds to spawn the instance on the hypervisor.
Aug 17 08:14:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:14:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:14:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:15:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:00 user nova-compute[72998]: INFO nova.compute.manager [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Took 13.63 seconds to build instance.
Aug 17 08:15:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-92a872a3-62b0-45df-b4f8-aaa76d1c077a tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.868s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:15:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json" returned: 0 in 0.547s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json" returned: 0 in 0.562s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json" returned: 0 in 0.372s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:06 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:15:06 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:15:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7645MB free_disk=24.667186737060547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:15:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:15:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ffb74821-5eff-4099-8bb6-d35d33ad1b87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 1178b496-7709-411f-a789-766d6eea004b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a06900f6-a39f-422f-a7c3-c89e1574602b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e087f5bf-889a-462d-a412-4a39e829f6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 08:15:07 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 08:15:08 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:15:08 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:15:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:15:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.351s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid e2b811f8-19a3-4b50-8ea9-6d3442c38819 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updating instance_info_cache with network_info: [{"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:15:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:15:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:15:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:15:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-db25e351-9eb0-4ba6-b2a9-a28b629740e4 req-b8d7a6f0-fbfc-4a72-afb2-66dd55925807 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received event network-changed-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-db25e351-9eb0-4ba6-b2a9-a28b629740e4 req-b8d7a6f0-fbfc-4a72-afb2-66dd55925807 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Refreshing instance network info cache due to event network-changed-fcaef72a-ce0c-491a-a108-1b7a74c5c58e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-db25e351-9eb0-4ba6-b2a9-a28b629740e4 req-b8d7a6f0-fbfc-4a72-afb2-66dd55925807 service nova] Acquiring lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-db25e351-9eb0-4ba6-b2a9-a28b629740e4 req-b8d7a6f0-fbfc-4a72-afb2-66dd55925807 service nova] Acquired lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG nova.network.neutron [req-db25e351-9eb0-4ba6-b2a9-a28b629740e4 req-b8d7a6f0-fbfc-4a72-afb2-66dd55925807 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Refreshing network info cache for port fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:15:57 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG nova.network.neutron [req-db25e351-9eb0-4ba6-b2a9-a28b629740e4 req-b8d7a6f0-fbfc-4a72-afb2-66dd55925807 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updated VIF entry in instance network info cache for port fcaef72a-ce0c-491a-a108-1b7a74c5c58e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG nova.network.neutron [req-db25e351-9eb0-4ba6-b2a9-a28b629740e4 req-b8d7a6f0-fbfc-4a72-afb2-66dd55925807 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updating instance_info_cache with network_info: [{"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-db25e351-9eb0-4ba6-b2a9-a28b629740e4 req-b8d7a6f0-fbfc-4a72-afb2-66dd55925807 service nova] Releasing lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updating instance_info_cache with network_info: [{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:15:58 user nova-compute[72998]: INFO nova.compute.manager [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Rescuing
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquired lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:15:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updating instance_info_cache with network_info: [{"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Releasing lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-e4df4dfd-6452-4a81-a82e-fba973b1b2da req-892ed833-7f0b-4b04-913d-fed018425745 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-unplugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e4df4dfd-6452-4a81-a82e-fba973b1b2da req-892ed833-7f0b-4b04-913d-fed018425745 service nova] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e4df4dfd-6452-4a81-a82e-fba973b1b2da req-892ed833-7f0b-4b04-913d-fed018425745 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e4df4dfd-6452-4a81-a82e-fba973b1b2da req-892ed833-7f0b-4b04-913d-fed018425745 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:15:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-e4df4dfd-6452-4a81-a82e-fba973b1b2da req-892ed833-7f0b-4b04-913d-fed018425745 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] No waiting events found dispatching network-vif-unplugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:15:59 user nova-compute[72998]: WARNING nova.compute.manager [req-e4df4dfd-6452-4a81-a82e-fba973b1b2da req-892ed833-7f0b-4b04-913d-fed018425745 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received unexpected event network-vif-unplugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 for instance with vm_state active and task_state rescuing.
Aug 17 08:15:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:00 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Instance destroyed successfully.
Aug 17 08:16:00 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Attempting rescue
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72998) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Instance directory exists: not creating {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 08:16:00 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Creating image(s)
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue" returned: 0 in 0.046s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'migration_context' on Instance uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Start _get_guest_xml network_info=[{"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "vif_mac": "fa:16:3e:7f:c7:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'resources' on Instance uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:16:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2108467117',display_name='tempest-ServerRescueNegativeTestJSON-server-2108467117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2108467117',id=4,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-zpdtk9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:26Z,user_data=None,user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=7b895ebd-5c4d-4350-9cbc-39e427e0cb05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "vif_mac": "fa:16:3e:7f:c7:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "vif_mac": "fa:16:3e:7f:c7:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:ba,bridge_name='br-int',has_traffic_filtering=True,id=a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8370d19-8e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:16:00 user nova-compute[72998]:   <uuid>7b895ebd-5c4d-4350-9cbc-39e427e0cb05</uuid>
Aug 17 08:16:00 user nova-compute[72998]:   <name>instance-00000004</name>
Aug 17 08:16:00 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:16:00 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:16:00 user nova-compute[72998]:   <metadata>
Aug 17 08:16:00 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:16:00 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:16:00 user nova-compute[72998]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2108467117</nova:name>
Aug 17 08:16:00 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:16:00</nova:creationTime>
Aug 17 08:16:00 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:16:00 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:16:00 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:16:00 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:16:00 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:16:00 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:16:00 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:16:00 user nova-compute[72998]:       <nova:owner>
Aug 17 08:16:00 user nova-compute[72998]:         <nova:user uuid="4cf59502a7ee46968534c860fc9f49f5">tempest-ServerRescueNegativeTestJSON-826615417-project-member</nova:user>
Aug 17 08:16:00 user nova-compute[72998]:         <nova:project uuid="8eaaef9c2492458bbe646bd227b11b64">tempest-ServerRescueNegativeTestJSON-826615417</nova:project>
Aug 17 08:16:00 user nova-compute[72998]:       </nova:owner>
Aug 17 08:16:00 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:16:00 user nova-compute[72998]:       <nova:ports>
Aug 17 08:16:00 user nova-compute[72998]:         <nova:port uuid="a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3">
Aug 17 08:16:00 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 08:16:00 user nova-compute[72998]:         </nova:port>
Aug 17 08:16:00 user nova-compute[72998]:       </nova:ports>
Aug 17 08:16:00 user nova-compute[72998]:     </nova:instance>
Aug 17 08:16:00 user nova-compute[72998]:   </metadata>
Aug 17 08:16:00 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:16:00 user nova-compute[72998]:     <system>
Aug 17 08:16:00 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:16:00 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:16:00 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:16:00 user nova-compute[72998]:       <entry name="serial">7b895ebd-5c4d-4350-9cbc-39e427e0cb05</entry>
Aug 17 08:16:00 user nova-compute[72998]:       <entry name="uuid">7b895ebd-5c4d-4350-9cbc-39e427e0cb05</entry>
Aug 17 08:16:00 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:16:00 user nova-compute[72998]:     </system>
Aug 17 08:16:00 user nova-compute[72998]:   </sysinfo>
Aug 17 08:16:00 user nova-compute[72998]:   <os>
Aug 17 08:16:00 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:16:00 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:16:00 user nova-compute[72998]:   </os>
Aug 17 08:16:00 user nova-compute[72998]:   <features>
Aug 17 08:16:00 user nova-compute[72998]:     <acpi/>
Aug 17 08:16:00 user nova-compute[72998]:     <apic/>
Aug 17 08:16:00 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:16:00 user nova-compute[72998]:   </features>
Aug 17 08:16:00 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:16:00 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:16:00 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:16:00 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:16:00 user nova-compute[72998]:   </clock>
Aug 17 08:16:00 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:16:00 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:16:00 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:16:00 user nova-compute[72998]:   </cpu>
Aug 17 08:16:00 user nova-compute[72998]:   <devices>
Aug 17 08:16:00 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:16:00 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:16:00 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue"/>
Aug 17 08:16:00 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:16:00 user nova-compute[72998]:     </disk>
Aug 17 08:16:00 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:16:00 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:16:00 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk"/>
Aug 17 08:16:00 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:16:00 user nova-compute[72998]:     </disk>
Aug 17 08:16:00 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:16:00 user nova-compute[72998]:       <mac address="fa:16:3e:7f:c7:ba"/>
Aug 17 08:16:00 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:16:00 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:16:00 user nova-compute[72998]:       <target dev="tapa8370d19-8e"/>
Aug 17 08:16:00 user nova-compute[72998]:     </interface>
Aug 17 08:16:00 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:16:00 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/console.log" append="off"/>
Aug 17 08:16:00 user nova-compute[72998]:     </serial>
Aug 17 08:16:00 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:16:00 user nova-compute[72998]:     <video>
Aug 17 08:16:00 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:16:00 user nova-compute[72998]:     </video>
Aug 17 08:16:00 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:16:00 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:16:00 user nova-compute[72998]:     </rng>
Aug 17 08:16:00 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:16:00 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:16:00 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:16:00 user nova-compute[72998]:     </memballoon>
Aug 17 08:16:00 user nova-compute[72998]:   </devices>
Aug 17 08:16:00 user nova-compute[72998]: </domain>
Aug 17 08:16:00 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:16:00 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Instance destroyed successfully.
Aug 17 08:16:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No VIF found with MAC fa:16:3e:7f:c7:ba, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG nova.compute.manager [req-b0b59459-6ab7-4457-8f41-4b37648632ac req-e8405d7e-3f10-47f5-a93a-9a33e68e210b service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b0b59459-6ab7-4457-8f41-4b37648632ac req-e8405d7e-3f10-47f5-a93a-9a33e68e210b service nova] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b0b59459-6ab7-4457-8f41-4b37648632ac req-e8405d7e-3f10-47f5-a93a-9a33e68e210b service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b0b59459-6ab7-4457-8f41-4b37648632ac req-e8405d7e-3f10-47f5-a93a-9a33e68e210b service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-b0b59459-6ab7-4457-8f41-4b37648632ac req-e8405d7e-3f10-47f5-a93a-9a33e68e210b service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] No waiting events found dispatching network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:02 user nova-compute[72998]: WARNING nova.compute.manager [req-b0b59459-6ab7-4457-8f41-4b37648632ac req-e8405d7e-3f10-47f5-a93a-9a33e68e210b service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received unexpected event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 for instance with vm_state active and task_state rescuing.
Aug 17 08:16:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lazy-loading 'flavor' on Instance uuid cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:02 user nova-compute[72998]: INFO nova.compute.manager [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Attaching volume 4202d37d-5474-4e78-afe6-55eda6d152a0 to /dev/vdb
Aug 17 08:16:02 user nova-compute[72998]: DEBUG os_brick.utils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:02 user nova-compute[72998]: INFO oslo.privsep.daemon [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpk4y2b2g_/privsep.sock']
Aug 17 08:16:02 user sudo[84625]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpk4y2b2g_/privsep.sock
Aug 17 08:16:02 user sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 08:16:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] No waiting events found dispatching network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:04 user nova-compute[72998]: WARNING nova.compute.manager [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received unexpected event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 for instance with vm_state active and task_state rescuing.
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] No waiting events found dispatching network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:04 user nova-compute[72998]: WARNING nova.compute.manager [req-70cc4338-1056-436d-9e07-06fafcf8879a req-da076cb3-adb1-4493-a599-629bff165288 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received unexpected event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 for instance with vm_state active and task_state rescuing.
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user sudo[84625]: pam_unix(sudo:session): session closed for user root
Aug 17 08:16:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:04 user nova-compute[72998]: INFO oslo.privsep.daemon [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Spawned new privsep daemon via rootwrap
Aug 17 08:16:04 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 08:16:04 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 08:16:04 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 17 08:16:04 user nova-compute[72998]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84658
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e29f5f-56b5-460c-a9b9-62f83270476d]: (2,) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a30cf3-7f8b-431d-b9f1-99fe5fdd012d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:04 user nova-compute[72998]: WARNING os_brick.initiator.connectors.nvmeof [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b133b94-fc83-447e-af83-706639f2a83e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a041c289-6534-4d54-b568-b617c0003afd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd4d162-d099-4432-bbb5-3149467d067d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:04 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[709177aa-b029-438b-994b-023b8306ce63]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG os_brick.utils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] <== get_connector_properties: return (2002ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Updating existing volume attachment record: 13c3269e-c7d1-46ed-95f7-731777fe6f38 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260164.8577251, 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:16:04 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] VM Resumed (Lifecycle Event)
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f17af959-d141-4298-b8ac-e0a0ab2d4fe2 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:16:04 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260164.858691, 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:16:04 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] VM Started (Lifecycle Event)
Aug 17 08:16:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:16:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:05 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 08:16:05 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:16:05 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=6951MB free_disk=24.49523162841797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ffb74821-5eff-4099-8bb6-d35d33ad1b87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 1178b496-7709-411f-a789-766d6eea004b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a06900f6-a39f-422f-a7c3-c89e1574602b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e087f5bf-889a-462d-a412-4a39e829f6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:16:05 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:16:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:16:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:16:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:16:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:16:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:16:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-3d48f8a2-b4c1-4a2f-bce5-7874c6d64ef4 req-efed4d1b-21be-4007-9cdf-09cfbc0393c2 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received event network-changed-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-3d48f8a2-b4c1-4a2f-bce5-7874c6d64ef4 req-efed4d1b-21be-4007-9cdf-09cfbc0393c2 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Refreshing instance network info cache due to event network-changed-adc18de6-340a-44b0-814b-f1c5345805f7. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3d48f8a2-b4c1-4a2f-bce5-7874c6d64ef4 req-efed4d1b-21be-4007-9cdf-09cfbc0393c2 service nova] Acquiring lock "refresh_cache-ffb74821-5eff-4099-8bb6-d35d33ad1b87" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3d48f8a2-b4c1-4a2f-bce5-7874c6d64ef4 req-efed4d1b-21be-4007-9cdf-09cfbc0393c2 service nova] Acquired lock "refresh_cache-ffb74821-5eff-4099-8bb6-d35d33ad1b87" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG nova.network.neutron [req-3d48f8a2-b4c1-4a2f-bce5-7874c6d64ef4 req-efed4d1b-21be-4007-9cdf-09cfbc0393c2 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Refreshing network info cache for port adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG nova.objects.instance [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lazy-loading 'flavor' on Instance uuid ffb74821-5eff-4099-8bb6-d35d33ad1b87 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:20 user nova-compute[72998]: INFO nova.compute.manager [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Attaching volume 2df6740b-f127-4bd2-b248-3239664d764e to /dev/vdb
Aug 17 08:16:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG os_brick.utils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbff0e3d-d1ef-4bc9-b281-39649d059d06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG nova.network.neutron [req-3d48f8a2-b4c1-4a2f-bce5-7874c6d64ef4 req-efed4d1b-21be-4007-9cdf-09cfbc0393c2 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Updated VIF entry in instance network info cache for port adc18de6-340a-44b0-814b-f1c5345805f7. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG nova.network.neutron [req-3d48f8a2-b4c1-4a2f-bce5-7874c6d64ef4 req-efed4d1b-21be-4007-9cdf-09cfbc0393c2 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Updating instance_info_cache with network_info: [{"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccda98b-f4a4-459b-aa4a-db74f25463f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3d48f8a2-b4c1-4a2f-bce5-7874c6d64ef4 req-efed4d1b-21be-4007-9cdf-09cfbc0393c2 service nova] Releasing lock "refresh_cache-ffb74821-5eff-4099-8bb6-d35d33ad1b87" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7cdc4-371d-4411-b7b1-4d4f1906a51e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8929a6fd-5c52-4150-aaa7-899363e57fab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:20 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:16:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[37538aab-f1d6-4f9e-bfa6-6d8c588bfea0]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG os_brick.utils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:20 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Updating existing volume attachment record: 926be41e-69d0-47fb-8e64-1e33bb3088be {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:16:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-72d6f61c-870e-4168-82e4-549d5d31c3cb req-69b0767b-8067-43b7-8534-a58088dac05e service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received event network-changed-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-72d6f61c-870e-4168-82e4-549d5d31c3cb req-69b0767b-8067-43b7-8534-a58088dac05e service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Refreshing instance network info cache due to event network-changed-10a46c87-9138-48a8-8228-2bf4501448b1. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:16:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-72d6f61c-870e-4168-82e4-549d5d31c3cb req-69b0767b-8067-43b7-8534-a58088dac05e service nova] Acquiring lock "refresh_cache-a06900f6-a39f-422f-a7c3-c89e1574602b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:16:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-72d6f61c-870e-4168-82e4-549d5d31c3cb req-69b0767b-8067-43b7-8534-a58088dac05e service nova] Acquired lock "refresh_cache-a06900f6-a39f-422f-a7c3-c89e1574602b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:16:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-72d6f61c-870e-4168-82e4-549d5d31c3cb req-69b0767b-8067-43b7-8534-a58088dac05e service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Refreshing network info cache for port 10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:16:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-72d6f61c-870e-4168-82e4-549d5d31c3cb req-69b0767b-8067-43b7-8534-a58088dac05e service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Updated VIF entry in instance network info cache for port 10a46c87-9138-48a8-8228-2bf4501448b1. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:16:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-72d6f61c-870e-4168-82e4-549d5d31c3cb req-69b0767b-8067-43b7-8534-a58088dac05e service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Updating instance_info_cache with network_info: [{"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-72d6f61c-870e-4168-82e4-549d5d31c3cb req-69b0767b-8067-43b7-8534-a58088dac05e service nova] Releasing lock "refresh_cache-a06900f6-a39f-422f-a7c3-c89e1574602b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connector [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Factory for ISCSI on None {{(pid=72998) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmCDwygf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:28 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:28 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:28 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[77769f5b-40c5-42f5-9d7f-a161322cf21d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:16:28 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f9ea80-5f24-4d05-8e5f-2be14c894413]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0] added
Aug 17 08:16:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c0c7d9-a083-4964-b5bf-973392ed7e90]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6aa53f-3d72-483c-9a0a-94d722d775ae]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmCDwygf {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UmCDwygf" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d584144b-62d9-4418-8447-b18a1b57580d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UmCDwygf'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[92051b56-863a-49f9-974e-fb134ff4239a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dfc666-82ca-41fc-a8fb-e3d492c360dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:16:28 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:16:28 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:28 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:16:28 user nova-compute[72998]: 
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82071c3-e715-4f70-952d-8daa9edabe78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0, portal: 172.16.0.220,3260]
Aug 17 08:16:28 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0, portal: 172.16.0.220,3260] successful.
Aug 17 08:16:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa99d823-b107-42b2-993a-b244c7c035cd]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2627bac-1090-4c0c-a0fb-a2927e498044]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 (non-flash)
Aug 17 08:16:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 (non-flash)
Aug 17 08:16:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[182d44b8-12f6-45de-9b19-f54ee6d40988]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:16:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmCDwygf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c657c510-e9dd-4667-85d2-0035c328eade req-17d7e5aa-80ce-48c2-ab95-d4c336fa94ca service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-changed-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c657c510-e9dd-4667-85d2-0035c328eade req-17d7e5aa-80ce-48c2-ab95-d4c336fa94ca service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Refreshing instance network info cache due to event network-changed-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c657c510-e9dd-4667-85d2-0035c328eade req-17d7e5aa-80ce-48c2-ab95-d4c336fa94ca service nova] Acquiring lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c657c510-e9dd-4667-85d2-0035c328eade req-17d7e5aa-80ce-48c2-ab95-d4c336fa94ca service nova] Acquired lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG nova.network.neutron [req-c657c510-e9dd-4667-85d2-0035c328eade req-17d7e5aa-80ce-48c2-ab95-d4c336fa94ca service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Refreshing network info cache for port 76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23264306239306661', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264306239306661', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:16:29 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lazy-loading 'flavor' on Instance uuid cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:16:30 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:30 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:16:30 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:16:30 user nova-compute[72998]:   <serial>4202d37d-5474-4e78-afe6-55eda6d152a0</serial>
Aug 17 08:16:30 user nova-compute[72998]: </disk>
Aug 17 08:16:30 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "interface-e087f5bf-889a-462d-a412-4a39e829f6ec-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "interface-e087f5bf-889a-462d-a412-4a39e829f6ec-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.objects.instance [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lazy-loading 'flavor' on Instance uuid e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lazy-loading 'flavor' on Instance uuid a06900f6-a39f-422f-a7c3-c89e1574602b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] No VIF found with MAC fa:16:3e:bb:8b:a9, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:30 user nova-compute[72998]: INFO nova.compute.manager [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Attaching volume 140b6cf4-1e7d-490b-83f7-ab027421866a to /dev/sdc
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e646cfa1-5390-498e-91c1-d733dd1761de tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.075s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG os_brick.utils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11e8673-df2e-452b-bdee-af40eb6ce162]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfd452b-fa3b-47cb-be13-e5b432f80049]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c94691-a455-4ccf-9922-b79c7d24bde1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d57b63-b21a-4269-a30d-396acea09064]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:30 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[220a5648-23d8-4684-a98b-6d091be8c792]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG os_brick.utils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Updating existing volume attachment record: b2d1b389-57a0-472a-b830-b416ec8016e4 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.objects.instance [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lazy-loading 'pci_requests' on Instance uuid e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.network.neutron [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-89d6ff74-8811-42cf-9b94-19c9d95138a0 req-eaaa11a9-0f02-4674-a6bb-692c5b44c8b4 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received event network-changed-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-89d6ff74-8811-42cf-9b94-19c9d95138a0 req-eaaa11a9-0f02-4674-a6bb-692c5b44c8b4 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Refreshing instance network info cache due to event network-changed-fc117be3-a78c-4709-83d5-8f2ff3ecfe88. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-89d6ff74-8811-42cf-9b94-19c9d95138a0 req-eaaa11a9-0f02-4674-a6bb-692c5b44c8b4 service nova] Acquiring lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-89d6ff74-8811-42cf-9b94-19c9d95138a0 req-eaaa11a9-0f02-4674-a6bb-692c5b44c8b4 service nova] Acquired lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.network.neutron [req-89d6ff74-8811-42cf-9b94-19c9d95138a0 req-eaaa11a9-0f02-4674-a6bb-692c5b44c8b4 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Refreshing network info cache for port fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.network.neutron [req-c657c510-e9dd-4667-85d2-0035c328eade req-17d7e5aa-80ce-48c2-ab95-d4c336fa94ca service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updated VIF entry in instance network info cache for port 76ac8bc8-ccbc-42fd-8caa-5c01cad6148f. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.network.neutron [req-c657c510-e9dd-4667-85d2-0035c328eade req-17d7e5aa-80ce-48c2-ab95-d4c336fa94ca service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updating instance_info_cache with network_info: [{"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c657c510-e9dd-4667-85d2-0035c328eade req-17d7e5aa-80ce-48c2-ab95-d4c336fa94ca service nova] Releasing lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:16:30 user nova-compute[72998]: DEBUG nova.policy [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14c6925b804342b7bee762e57a0fe9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9985c560f34f4991b6cb938d8b6fcd57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG nova.network.neutron [req-89d6ff74-8811-42cf-9b94-19c9d95138a0 req-eaaa11a9-0f02-4674-a6bb-692c5b44c8b4 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Updated VIF entry in instance network info cache for port fc117be3-a78c-4709-83d5-8f2ff3ecfe88. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG nova.network.neutron [req-89d6ff74-8811-42cf-9b94-19c9d95138a0 req-eaaa11a9-0f02-4674-a6bb-692c5b44c8b4 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Updating instance_info_cache with network_info: [{"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-89d6ff74-8811-42cf-9b94-19c9d95138a0 req-eaaa11a9-0f02-4674-a6bb-692c5b44c8b4 service nova] Releasing lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG nova.network.neutron [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Successfully created port: 80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:31 user nova-compute[72998]: INFO nova.compute.manager [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Terminating instance
Aug 17 08:16:31 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:32 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Instance destroyed successfully.
Aug 17 08:16:32 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lazy-loading 'resources' on Instance uuid cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-262231603',display_name='tempest-DeleteServersTestJSON-server-262231603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-262231603',id=3,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c2f87621e044e57be7a4632c3d4dba3',ramdisk_id='',reservation_id='r-51kgvb5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-712265908',owner_user_name='tempest-DeleteServersTestJSON-712265908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:27Z,user_data=None,user_id='ae660169ef314445b77c0dc8ad8c0e46',uuid=cda1f6e2-bdea-4d64-bdde-e7a839cae7e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Converting VIF {"id": "b9139967-deff-45c2-84d5-6234f414bcd4", "address": "fa:16:3e:bb:8b:a9", "network": {"id": "822fa31f-5d57-4813-8cd2-73f065be4a83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-493045143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c2f87621e044e57be7a4632c3d4dba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9139967-de", "ovs_interfaceid": "b9139967-deff-45c2-84d5-6234f414bcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:a9,bridge_name='br-int',has_traffic_filtering=True,id=b9139967-deff-45c2-84d5-6234f414bcd4,network=Network(822fa31f-5d57-4813-8cd2-73f065be4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9139967-de') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_vif [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:a9,bridge_name='br-int',has_traffic_filtering=True,id=b9139967-deff-45c2-84d5-6234f414bcd4,network=Network(822fa31f-5d57-4813-8cd2-73f065be4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9139967-de') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9139967-de, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:16:32 user nova-compute[72998]: INFO os_vif [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:a9,bridge_name='br-int',has_traffic_filtering=True,id=b9139967-deff-45c2-84d5-6234f414bcd4,network=Network(822fa31f-5d57-4813-8cd2-73f065be4a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9139967-de')
Aug 17 08:16:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UmCDwygf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:32 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[52544fe3-728a-4135-8a83-8876972e24e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e8ae6f-e754-4c07-930a-e361c907552b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 (non-flash)
Aug 17 08:16:32 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 (non-flash)
Aug 17 08:16:32 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4884d6830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7ec6c5-a080-405b-bb81-3f734715e612]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667f990-23ca-4113-8fff-cd6d0b1c3aea]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00c0597-21bb-48ac-9287-2c7525130716]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3199cac-b8b6-468c-98c6-30c6e2381053]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-23cce1d0-30a0-44d0-8773-3ee00ccb9bce req-cb5bfaa4-b74f-4963-bad1-69e23e9f7340 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received event network-vif-unplugged-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-23cce1d0-30a0-44d0-8773-3ee00ccb9bce req-cb5bfaa4-b74f-4963-bad1-69e23e9f7340 service nova] Acquiring lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-23cce1d0-30a0-44d0-8773-3ee00ccb9bce req-cb5bfaa4-b74f-4963-bad1-69e23e9f7340 service nova] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-23cce1d0-30a0-44d0-8773-3ee00ccb9bce req-cb5bfaa4-b74f-4963-bad1-69e23e9f7340 service nova] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-23cce1d0-30a0-44d0-8773-3ee00ccb9bce req-cb5bfaa4-b74f-4963-bad1-69e23e9f7340 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] No waiting events found dispatching network-vif-unplugged-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-23cce1d0-30a0-44d0-8773-3ee00ccb9bce req-cb5bfaa4-b74f-4963-bad1-69e23e9f7340 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received event network-vif-unplugged-b9139967-deff-45c2-84d5-6234f414bcd4 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a2fb66-8822-4348-82bb-6005bc1730ee]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b414fcb-0eef-4a02-a1bd-12c5e73ad3c7]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0, portal: 172.16.0.220,3260]
Aug 17 08:16:32 user nova-compute[72998]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0, portal: 172.16.0.220,3260] successful.
Aug 17 08:16:32 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4202d37d-5474-4e78-afe6-55eda6d152a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4987a1-4a06-481a-8f64-1506861a5519]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] <== disconnect_volume: return (293ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:16:33 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Deleting instance files /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6_del
Aug 17 08:16:33 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Deletion of /opt/stack/data/nova/instances/cda1f6e2-bdea-4d64-bdde-e7a839cae7e6_del complete
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72998) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 17 08:16:33 user nova-compute[72998]: INFO nova.virt.libvirt.host [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] UEFI support detected
Aug 17 08:16:33 user nova-compute[72998]: INFO nova.compute.manager [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 17 08:16:33 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.neutron [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Successfully updated port: 80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquired lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.neutron [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:33 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Took 0.70 seconds to deallocate network for instance.
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-01dee892-a2dd-45a6-9176-3fd4f9a2fc24 req-63af7edd-b078-4fb5-bb03-f5cc392c3241 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received event network-vif-deleted-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:33 user nova-compute[72998]: INFO nova.compute.manager [req-01dee892-a2dd-45a6-9176-3fd4f9a2fc24 req-63af7edd-b078-4fb5-bb03-f5cc392c3241 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Neutron deleted interface b9139967-deff-45c2-84d5-6234f414bcd4; detaching it from the instance and deleting it from the info cache
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.neutron [req-01dee892-a2dd-45a6-9176-3fd4f9a2fc24 req-63af7edd-b078-4fb5-bb03-f5cc392c3241 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-01dee892-a2dd-45a6-9176-3fd4f9a2fc24 req-63af7edd-b078-4fb5-bb03-f5cc392c3241 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Detach interface failed, port_id=b9139967-deff-45c2-84d5-6234f414bcd4, reason: Instance cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.neutron [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updating instance_info_cache with network_info: [{"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Releasing lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900252933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900252933',id=8,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVTnC3gnP971i31Ttky/4Xg/EnkXcozD7zi9pP8iuMWUahf+05KbIMa109iWM3ukXkgnqBJa6j0JfmxF37zj1tzySFuAQ4DGs1cYm513zaFxLSVFwigoX2hV94IwNMXxg==',key_name='tempest-keypair-1262423847',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9985c560f34f4991b6cb938d8b6fcd57',ramdisk_id='',reservation_id='r-3vy0dn1m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1304973980',owner_user_name='tempest-TaggedAttachmentsTest-1304973980-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14c6925b804342b7bee762e57a0fe9a1',uuid=e087f5bf-889a-462d-a412-4a39e829f6ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converting VIF {"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9a:23,bridge_name='br-int',has_traffic_filtering=True,id=80262617-85f7-4207-abd3-0ce52525fa96,network=Network(fabf1d10-28f1-447b-b7c0-86ecb5554324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80262617-85') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG os_vif [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9a:23,bridge_name='br-int',has_traffic_filtering=True,id=80262617-85f7-4207-abd3-0ce52525fa96,network=Network(fabf1d10-28f1-447b-b7c0-86ecb5554324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80262617-85') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80262617-85, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80262617-85, col_values=(('external_ids', {'iface-id': '80262617-85f7-4207-abd3-0ce52525fa96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:9a:23', 'vm-uuid': 'e087f5bf-889a-462d-a412-4a39e829f6ec'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:33 user nova-compute[72998]: INFO os_vif [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9a:23,bridge_name='br-int',has_traffic_filtering=True,id=80262617-85f7-4207-abd3-0ce52525fa96,network=Network(fabf1d10-28f1-447b-b7c0-86ecb5554324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80262617-85')
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900252933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900252933',id=8,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVTnC3gnP971i31Ttky/4Xg/EnkXcozD7zi9pP8iuMWUahf+05KbIMa109iWM3ukXkgnqBJa6j0JfmxF37zj1tzySFuAQ4DGs1cYm513zaFxLSVFwigoX2hV94IwNMXxg==',key_name='tempest-keypair-1262423847',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9985c560f34f4991b6cb938d8b6fcd57',ramdisk_id='',reservation_id='r-3vy0dn1m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1304973980',owner_user_name='tempest-TaggedAttachmentsTest-1304973980-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14c6925b804342b7bee762e57a0fe9a1',uuid=e087f5bf-889a-462d-a412-4a39e829f6ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converting VIF {"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9a:23,bridge_name='br-int',has_traffic_filtering=True,id=80262617-85f7-4207-abd3-0ce52525fa96,network=Network(fabf1d10-28f1-447b-b7c0-86ecb5554324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80262617-85') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] attach device xml: <interface type="ethernet">
Aug 17 08:16:33 user nova-compute[72998]:   <mac address="fa:16:3e:42:9a:23"/>
Aug 17 08:16:33 user nova-compute[72998]:   <model type="virtio"/>
Aug 17 08:16:33 user nova-compute[72998]:   <mtu size="1442"/>
Aug 17 08:16:33 user nova-compute[72998]:   <target dev="tap80262617-85"/>
Aug 17 08:16:33 user nova-compute[72998]: </interface>
Aug 17 08:16:33 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:16:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] No BDM found with device name hda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] No VIF found with MAC fa:16:3e:6c:e7:43, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:16:34 user nova-compute[72998]:   <nova:package version="0.0.0"/>
Aug 17 08:16:34 user nova-compute[72998]:   <nova:name>tempest-device-tagging-server-900252933</nova:name>
Aug 17 08:16:34 user nova-compute[72998]:   <nova:creationTime>2023-08-17 08:16:34</nova:creationTime>
Aug 17 08:16:34 user nova-compute[72998]:   <nova:flavor name="m1.tiny">
Aug 17 08:16:34 user nova-compute[72998]:     <nova:memory>512</nova:memory>
Aug 17 08:16:34 user nova-compute[72998]:     <nova:disk>1</nova:disk>
Aug 17 08:16:34 user nova-compute[72998]:     <nova:swap>0</nova:swap>
Aug 17 08:16:34 user nova-compute[72998]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:16:34 user nova-compute[72998]:     <nova:vcpus>1</nova:vcpus>
Aug 17 08:16:34 user nova-compute[72998]:   </nova:flavor>
Aug 17 08:16:34 user nova-compute[72998]:   <nova:owner>
Aug 17 08:16:34 user nova-compute[72998]:     <nova:user uuid="14c6925b804342b7bee762e57a0fe9a1">tempest-TaggedAttachmentsTest-1304973980-project-member</nova:user>
Aug 17 08:16:34 user nova-compute[72998]:     <nova:project uuid="9985c560f34f4991b6cb938d8b6fcd57">tempest-TaggedAttachmentsTest-1304973980</nova:project>
Aug 17 08:16:34 user nova-compute[72998]:   </nova:owner>
Aug 17 08:16:34 user nova-compute[72998]:   <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:16:34 user nova-compute[72998]:   <nova:ports>
Aug 17 08:16:34 user nova-compute[72998]:     <nova:port uuid="76ac8bc8-ccbc-42fd-8caa-5c01cad6148f">
Aug 17 08:16:34 user nova-compute[72998]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:16:34 user nova-compute[72998]:     </nova:port>
Aug 17 08:16:34 user nova-compute[72998]:     <nova:port uuid="80262617-85f7-4207-abd3-0ce52525fa96">
Aug 17 08:16:34 user nova-compute[72998]:       <nova:ip type="fixed" address="10.10.10.147" ipVersion="4"/>
Aug 17 08:16:34 user nova-compute[72998]:     </nova:port>
Aug 17 08:16:34 user nova-compute[72998]:   </nova:ports>
Aug 17 08:16:34 user nova-compute[72998]: </nova:instance>
Aug 17 08:16:34 user nova-compute[72998]:  {{(pid=72998) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-aab5b992-26c9-42fe-b199-8c5c2fb6eed4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "interface-e087f5bf-889a-462d-a412-4a39e829f6ec-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.328s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:34 user nova-compute[72998]: INFO nova.compute.manager [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Took 1.01 seconds to detach 1 volumes for instance.
Aug 17 08:16:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG nova.compute.manager [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received event network-vif-plugged-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] Acquiring lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG nova.compute.manager [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] No waiting events found dispatching network-vif-plugged-b9139967-deff-45c2-84d5-6234f414bcd4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:34 user nova-compute[72998]: WARNING nova.compute.manager [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Received unexpected event network-vif-plugged-b9139967-deff-45c2-84d5-6234f414bcd4 for instance with vm_state deleted and task_state None.
Aug 17 08:16:34 user nova-compute[72998]: DEBUG nova.compute.manager [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-changed-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG nova.compute.manager [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Refreshing instance network info cache due to event network-changed-80262617-85f7-4207-abd3-0ce52525fa96. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] Acquiring lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] Acquired lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:16:34 user nova-compute[72998]: DEBUG nova.network.neutron [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Refreshing network info cache for port 80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquiring lock "1178b496-7709-411f-a789-766d6eea004b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "1178b496-7709-411f-a789-766d6eea004b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquiring lock "1178b496-7709-411f-a789-766d6eea004b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "1178b496-7709-411f-a789-766d6eea004b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "1178b496-7709-411f-a789-766d6eea004b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:35 user nova-compute[72998]: INFO nova.compute.manager [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Terminating instance
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.objects.instance [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lazy-loading 'flavor' on Instance uuid e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:35 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Deleted allocations for instance cda1f6e2-bdea-4d64-bdde-e7a839cae7e6
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:35 user nova-compute[72998]: INFO nova.compute.manager [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Attaching volume 716d1e80-e6a1-401f-bb39-8205f62ef181 to /dev/vdb
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e1326e49-44ce-4818-8a52-9654c53f7e36 tempest-DeleteServersTestJSON-712265908 tempest-DeleteServersTestJSON-712265908-project-member] Lock "cda1f6e2-bdea-4d64-bdde-e7a839cae7e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.827s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG os_brick.utils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4456e9d-6bad-43f7-b7b8-872aa758f598]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd82bdf-8462-4ee4-8eeb-5a3ae29580ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7635db-8342-4124-975b-ec12dec347ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f00e07b-ef95-4a29-b0df-c44f97ab937a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:35 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd357cd-9bd9-49b1-bcdd-341fe5dd8e01]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG os_brick.utils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updating existing volume attachment record: b417e8e8-f7c5-4c72-b929-eb1e14435492 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-plugged-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-plugged-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:35 user nova-compute[72998]: WARNING nova.compute.manager [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-plugged-80262617-85f7-4207-abd3-0ce52525fa96 for instance with vm_state active and task_state None.
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-plugged-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-plugged-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:35 user nova-compute[72998]: WARNING nova.compute.manager [req-c942c5b5-5252-4117-824a-753ec6dce169 req-888d0121-465f-4da3-840d-c8a2b0777b84 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-plugged-80262617-85f7-4207-abd3-0ce52525fa96 for instance with vm_state active and task_state None.
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updated VIF entry in instance network info cache for port 80262617-85f7-4207-abd3-0ce52525fa96. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updating instance_info_cache with network_info: [{"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:35 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 1178b496-7709-411f-a789-766d6eea004b] Instance destroyed successfully.
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lazy-loading 'resources' on Instance uuid 1178b496-7709-411f-a789-766d6eea004b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-982697197',display_name='tempest-VolumesActionsTest-instance-982697197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-982697197',id=6,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35d7aae117654398996e22cb255c8584',ramdisk_id='',reservation_id='r-a6urf7q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1504737873',owner_user_name='tempest-VolumesActionsTest-1504737873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:52Z,user_data=None,user_id='f3db31250e9e4e71853b077aef0af43d',uuid=1178b496-7709-411f-a789-766d6eea004b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Converting VIF {"id": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "address": "fa:16:3e:fa:91:aa", "network": {"id": "a2350d59-07c2-443d-9603-dd1807ac62d0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1154985400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35d7aae117654398996e22cb255c8584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bb8838-cd", "ovs_interfaceid": "91bb8838-cd5e-4692-ab34-5bccb072a0dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:91:aa,bridge_name='br-int',has_traffic_filtering=True,id=91bb8838-cd5e-4692-ab34-5bccb072a0dc,network=Network(a2350d59-07c2-443d-9603-dd1807ac62d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bb8838-cd') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG os_vif [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:91:aa,bridge_name='br-int',has_traffic_filtering=True,id=91bb8838-cd5e-4692-ab34-5bccb072a0dc,network=Network(a2350d59-07c2-443d-9603-dd1807ac62d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bb8838-cd') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91bb8838-cd, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe4b7fa3-dfdd-472d-899b-13eb90a3ef9f req-7b67352c-3c10-4202-8b9a-f9fe642d4cb6 service nova] Releasing lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:16:36 user nova-compute[72998]: INFO os_vif [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:91:aa,bridge_name='br-int',has_traffic_filtering=True,id=91bb8838-cd5e-4692-ab34-5bccb072a0dc,network=Network(a2350d59-07c2-443d-9603-dd1807ac62d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bb8838-cd')
Aug 17 08:16:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Deleting instance files /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b_del
Aug 17 08:16:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Deletion of /opt/stack/data/nova/instances/1178b496-7709-411f-a789-766d6eea004b_del complete
Aug 17 08:16:36 user nova-compute[72998]: INFO nova.compute.manager [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] [instance: 1178b496-7709-411f-a789-766d6eea004b] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 08:16:36 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:16:36 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 1178b496-7709-411f-a789-766d6eea004b] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:16:36 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 1178b496-7709-411f-a789-766d6eea004b] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:16:36 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 1178b496-7709-411f-a789-766d6eea004b] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:36 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 1178b496-7709-411f-a789-766d6eea004b] Took 0.68 seconds to deallocate network for instance.
Aug 17 08:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received event network-vif-unplugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] Acquiring lock "1178b496-7709-411f-a789-766d6eea004b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] Lock "1178b496-7709-411f-a789-766d6eea004b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] Lock "1178b496-7709-411f-a789-766d6eea004b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] No waiting events found dispatching network-vif-unplugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:37 user nova-compute[72998]: WARNING nova.compute.manager [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received unexpected event network-vif-unplugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc for instance with vm_state deleted and task_state None.
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received event network-vif-plugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] Acquiring lock "1178b496-7709-411f-a789-766d6eea004b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] Lock "1178b496-7709-411f-a789-766d6eea004b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] Lock "1178b496-7709-411f-a789-766d6eea004b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] No waiting events found dispatching network-vif-plugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:37 user nova-compute[72998]: WARNING nova.compute.manager [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received unexpected event network-vif-plugged-91bb8838-cd5e-4692-ab34-5bccb072a0dc for instance with vm_state deleted and task_state None.
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-95cf5636-a90a-4cea-a153-6d1ed13625b6 req-57704186-0476-4c50-92ff-a1a52756bfbd service nova] [instance: 1178b496-7709-411f-a789-766d6eea004b] Received event network-vif-deleted-91bb8838-cd5e-4692-ab34-5bccb072a0dc {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:37 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Deleted allocations for instance 1178b496-7709-411f-a789-766d6eea004b
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2538ed55-7fe5-4028-bc4a-f0fa78f3aa7e tempest-VolumesActionsTest-1504737873 tempest-VolumesActionsTest-1504737873-project-member] Lock "1178b496-7709-411f-a789-766d6eea004b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.313s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-bb5db948-1131-422c-8e9c-dbeba8248522 req-4ae9a885-d799-46af-83cc-592c4f461e11 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received event network-changed-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-bb5db948-1131-422c-8e9c-dbeba8248522 req-4ae9a885-d799-46af-83cc-592c4f461e11 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Refreshing instance network info cache due to event network-changed-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bb5db948-1131-422c-8e9c-dbeba8248522 req-4ae9a885-d799-46af-83cc-592c4f461e11 service nova] Acquiring lock "refresh_cache-c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bb5db948-1131-422c-8e9c-dbeba8248522 req-4ae9a885-d799-46af-83cc-592c4f461e11 service nova] Acquired lock "refresh_cache-c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:16:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-bb5db948-1131-422c-8e9c-dbeba8248522 req-4ae9a885-d799-46af-83cc-592c4f461e11 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Refreshing network info cache for port a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:16:38 user nova-compute[72998]: DEBUG nova.network.neutron [req-bb5db948-1131-422c-8e9c-dbeba8248522 req-4ae9a885-d799-46af-83cc-592c4f461e11 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Updated VIF entry in instance network info cache for port a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:16:38 user nova-compute[72998]: DEBUG nova.network.neutron [req-bb5db948-1131-422c-8e9c-dbeba8248522 req-4ae9a885-d799-46af-83cc-592c4f461e11 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Updating instance_info_cache with network_info: [{"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bb5db948-1131-422c-8e9c-dbeba8248522 req-4ae9a885-d799-46af-83cc-592c4f461e11 service nova] Releasing lock "refresh_cache-c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:16:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhzmowPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:43 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:43 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:43 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[126faf8c-1694-4cf6-b220-99b6c931bec7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:16:43 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b309cb-2e3b-482a-b581-f485626deae0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e] added
Aug 17 08:16:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6fee78-9c72-42c4-972f-0453ee0515c4]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3fadd3-5071-49db-8219-a817694ecbf4]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhzmowPA {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhzmowPA" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b615cd-20bc-4b56-90e5-6687f73cd008]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EhzmowPA'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1bf514-edbc-44ce-888e-4cfb32bf4834]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[654c31b9-9cef-42b7-a081-1675ea8c9820]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:16:43 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:16:43 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:43 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:16:43 user nova-compute[72998]: 
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdd7515-a7d3-409b-9ee8-de47b1962920]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e, portal: 172.16.0.220,3260]
Aug 17 08:16:43 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e, portal: 172.16.0.220,3260] successful.
Aug 17 08:16:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lazy-loading 'flavor' on Instance uuid c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[118da8f2-c7fc-4283-b6c0-eb4805bd5752]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b043c28-3d85-463b-a9ab-9689d5e66b5d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.472s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda13622-4d9f-4fcd-a8f7-3bb45c9e51fc]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lazy-loading 'flavor' on Instance uuid e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:44 user nova-compute[72998]: INFO nova.compute.manager [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Attaching volume e4228be6-ba70-4efe-b04d-e86a9d58368a to /dev/vdb
Aug 17 08:16:44 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:16:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhzmowPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:16:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23862326330663864', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862326330663864', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:16:44 user nova-compute[72998]: DEBUG nova.objects.instance [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lazy-loading 'flavor' on Instance uuid ffb74821-5eff-4099-8bb6-d35d33ad1b87 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:44 user nova-compute[72998]: INFO nova.compute.manager [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Attaching volume af0fde0f-35a9-496f-bb24-0a3790f33e08 to /dev/vdb
Aug 17 08:16:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] attach device xml: <disk type="block" device="disk">
Aug 17 08:16:44 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:44 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:16:44 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:16:44 user nova-compute[72998]:   <serial>2df6740b-f127-4bd2-b248-3239664d764e</serial>
Aug 17 08:16:44 user nova-compute[72998]: </disk>
Aug 17 08:16:44 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] No VIF found with MAC fa:16:3e:1b:d7:33, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[66487bdd-74af-49f3-99a1-29b3a9097ec2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff04e70-efae-4ef9-9acc-83a138702485]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1b6922-99cc-484f-a61e-32a997e0636f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eee12a-275b-4c03-b52e-f9a2b2f96e66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:45 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db6f758-0b7d-44bf-b3ff-7181c085613e]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Updating existing volume attachment record: 7200f380-175d-4dc5-a138-8610ac141e29 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92e44ae-a8a8-4409-b7cd-33ec52c1d9fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd1a71d-8b40-40df-a425-4f3d278e92b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cae3d2-d90b-458a-b092-747f7ef19cbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d945beeb-8622-4b98-9acc-1b7517674257]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-44fa7ca5-d08f-497c-b0ff-74f4d36f126c tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.384s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:16:45 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cfa9e9-7a34-4ac8-a220-d2ab34983b7d]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Updating existing volume attachment record: a3ff2022-53d7-4f4e-87d6-6ab04a7c9bf7 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHUAtqJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:45 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:45 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:45 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e2f2e-5f2e-4635-941a-b65df8f60ad2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:16:45 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd003a65-c99a-4e05-abf6-71eff4217a0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a] added
Aug 17 08:16:45 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec91eb-9b3e-4362-9c3a-5996ea3ffa1a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fe64b1-69a5-4bf7-ab62-62804fdfbe9c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHUAtqJe {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHUAtqJe" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fefaa6e-e7aa-430a-96f3-239508c1a42b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KHUAtqJe'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6856ad-3c44-43b3-9db2-c000a1608158]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeafe63-ddac-447e-9d9a-1a143527c686]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:46 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:46 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad511cc-404e-48db-9a5f-93866b60e300]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a, portal: 172.16.0.220,3260]
Aug 17 08:16:46 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a, portal: 172.16.0.220,3260] successful.
Aug 17 08:16:46 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[33191b7f-1046-43d0-a933-c298b83b5acf]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfe3be0-aa58-477c-9d46-a1e8039621ba]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:46 user nova-compute[72998]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:46 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:46 user nova-compute[72998]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:46 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3078d9b9-be4b-4bc6-a553-d53eed5db351]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSbCLYHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:46 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHUAtqJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23363336361626438', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363336361626438', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.292s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:47 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:47 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lazy-loading 'flavor' on Instance uuid a06900f6-a39f-422f-a7c3-c89e1574602b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[53932dea-4ec5-4be3-8026-e6c97b181a30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:16:47 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dfeb47-9d29-4795-b6ff-c9c1aff74b9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181] added
Aug 17 08:16:47 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:16:47 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:47 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:16:47 user nova-compute[72998]:   <target dev="sdc" bus="scsi"/>
Aug 17 08:16:47 user nova-compute[72998]:   <serial>140b6cf4-1e7d-490b-83f7-ab027421866a</serial>
Aug 17 08:16:47 user nova-compute[72998]:   <address type="drive" controller="0" unit="2"/>
Aug 17 08:16:47 user nova-compute[72998]: </disk>
Aug 17 08:16:47 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa5dd80-fe0d-41cb-8f3f-c2559ce68880]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf1f48c-86ed-45f0-8676-a7793cbfe4b7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XSbCLYHf {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XSbCLYHf" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b368b0-54ee-4cd7-858b-cc9bc6624ba7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XSbCLYHf'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-83e5561d-6006-4519-bbef-ffde3fd989b5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] volume_snapshot_create: create_info: {'snapshot_id': 'b4e7967b-30b9-4f0b-bc29-312c71da2224', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72998) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[402beb52-6652-4770-a612-4dae8c4e3973]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-83e5561d-6006-4519-bbef-ffde3fd989b5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] snap xml: <domainsnapshot>
Aug 17 08:16:47 user nova-compute[72998]:   <disks>
Aug 17 08:16:47 user nova-compute[72998]:     <disk name="/dev/sdb" snapshot="external" type="file">
Aug 17 08:16:47 user nova-compute[72998]:       <source file="/dev/new_file"/>
Aug 17 08:16:47 user nova-compute[72998]:     </disk>
Aug 17 08:16:47 user nova-compute[72998]:     <disk name="vda" snapshot="no"/>
Aug 17 08:16:47 user nova-compute[72998]:   </disks>
Aug 17 08:16:47 user nova-compute[72998]: </domainsnapshot>
Aug 17 08:16:47 user nova-compute[72998]:  {{(pid=72998) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-83e5561d-6006-4519-bbef-ffde3fd989b5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lazy-loading 'system_metadata' on Instance uuid ffb74821-5eff-4099-8bb6-d35d33ad1b87 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6869ca7f-1262-499b-9e21-c11c0f96a5a0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:47 user nova-compute[72998]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:47 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:47 user nova-compute[72998]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:47 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1b056bf4-2203-4b83-bffd-da3fc12b07f5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] volume_snapshot_delete: delete_info: {'volume_id': '2df6740b-f127-4bd2-b248-3239664d764e'} {{(pid=72998) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [None req-1b056bf4-2203-4b83-bffd-da3fc12b07f5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     if delete_info['type'] != 'qcow2':
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] KeyError: 'type'
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] 
Aug 17 08:16:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-83e5561d-6006-4519-bbef-ffde3fd989b5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75130e1-707c-439b-bc45-e1a390ee22b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181, portal: 172.16.0.220,3260]
Aug 17 08:16:47 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181, portal: 172.16.0.220,3260] successful.
Aug 17 08:16:47 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [None req-83e5561d-6006-4519-bbef-ffde3fd989b5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     rv = execute(f, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     six.reraise(c, e, tb)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     raise value
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     rv = meth(*args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [None req-83e5561d-6006-4519-bbef-ffde3fd989b5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     self._volume_snapshot_create(context, instance, guest,
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     rv = execute(f, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     six.reraise(c, e, tb)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     raise value
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     rv = meth(*args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] 
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[910fba6a-b9bf-4753-aef5-26f162079306]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260192.5566573, cda1f6e2-bdea-4d64-bdde-e7a839cae7e6 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:16:47 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] VM Stopped (Lifecycle Event)
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcad3e0-0198-44ff-a281-323ddbc77bdb]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:47 user nova-compute[72998]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:47 user nova-compute[72998]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)
Aug 17 08:16:47 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:47 user nova-compute[72998]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:47 user nova-compute[72998]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)
Aug 17 08:16:47 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [None req-1b056bf4-2203-4b83-bffd-da3fc12b07f5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-21c5615e-483f-4378-9d3a-b501f593d56a)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-c6ac2f52-8ec4-4316-be85-be8b671df193 None None] [instance: cda1f6e2-bdea-4d64-bdde-e7a839cae7e6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server [None req-1b056bf4-2203-4b83-bffd-da3fc12b07f5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Exception during message handling: KeyError: 'type'
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver [None req-83e5561d-6006-4519-bbef-ffde3fd989b5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b4e7967b-30b9-4f0b-bc29-312c71da2224 could not be found.
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     raise value
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b4e7967b-30b9-4f0b-bc29-312c71da2224 could not be found. (HTTP 404) (Request-ID: req-7b9d4767-15e4-4ac8-bec5-4ceb84472b95)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b4e7967b-30b9-4f0b-bc29-312c71da2224 could not be found.
Aug 17 08:16:47 user nova-compute[72998]: ERROR nova.virt.libvirt.driver 
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f34000a-d219-4474-b754-36c5a524cf14]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSbCLYHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server [None req-83e5561d-6006-4519-bbef-ffde3fd989b5 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     raise value
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 08:16:47 user nova-compute[72998]: ERROR oslo_messaging.rpc.server 
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] No BDM found with device name sda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] No VIF found with MAC fa:16:3e:0d:94:99, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:16:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0a38a3c-b5b2-45d8-be08-6226007ba36b tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.424s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:48 user nova-compute[72998]: INFO nova.compute.manager [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Detaching volume 2df6740b-f127-4bd2-b248-3239664d764e
Aug 17 08:16:48 user nova-compute[72998]: INFO nova.virt.block_device [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Attempting to driver detach volume 2df6740b-f127-4bd2-b248-3239664d764e from mountpoint /dev/vdb
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Attempting to detach device vdb from instance ffb74821-5eff-4099-8bb6-d35d33ad1b87 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 08:16:48 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:48 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:16:48 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:16:48 user nova-compute[72998]:   <serial>2df6740b-f127-4bd2-b248-3239664d764e</serial>
Aug 17 08:16:48 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:16:48 user nova-compute[72998]: </disk>
Aug 17 08:16:48 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:16:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Successfully detached device vdb from instance ffb74821-5eff-4099-8bb6-d35d33ad1b87 from the persistent domain config.
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffb74821-5eff-4099-8bb6-d35d33ad1b87 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 08:16:48 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:48 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:16:48 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:16:48 user nova-compute[72998]:   <serial>2df6740b-f127-4bd2-b248-3239664d764e</serial>
Aug 17 08:16:48 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:16:48 user nova-compute[72998]: </disk>
Aug 17 08:16:48 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260208.6027184, ffb74821-5eff-4099-8bb6-d35d33ad1b87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffb74821-5eff-4099-8bb6-d35d33ad1b87 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:16:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Successfully detached device vdb from instance ffb74821-5eff-4099-8bb6-d35d33ad1b87 from the live domain config.
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhzmowPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:48 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] <== connect_volume: return (1730ms) {'type': 'block', 'scsi_wwn': '23437633437363836', 'path': '/dev/sdd'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437633437363836', 'path': '/dev/sdd'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.013s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.objects.instance [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lazy-loading 'flavor' on Instance uuid e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e700d5-521b-46f4-aebd-a352dfd9b00d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:16:48 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:48 user nova-compute[72998]:   <source dev="/dev/sdd"/>
Aug 17 08:16:48 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:16:48 user nova-compute[72998]:   <serial>716d1e80-e6a1-401f-bb39-8205f62ef181</serial>
Aug 17 08:16:48 user nova-compute[72998]: </disk>
Aug 17 08:16:48 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52c818-1a5a-4c0f-9e7e-f19372d946b0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:48 user nova-compute[72998]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:48 user nova-compute[72998]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)
Aug 17 08:16:48 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e (non-flash)
Aug 17 08:16:48 user nova-compute[72998]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:48 user nova-compute[72998]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)
Aug 17 08:16:48 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464d76710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac0e9cd-8019-40bf-b8d5-2476dbef884c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3504f883-1cef-4cf1-b97a-eb3918d903d0]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e7823-936b-4db5-8297-f5eccecf98de]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:16:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9964f789-4598-4057-9b0c-de2f2c211fd2]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e0703a-c760-4d10-8ade-543c81e0aa06]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: INFO nova.compute.manager [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Detaching volume 140b6cf4-1e7d-490b-83f7-ab027421866a
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] No BDM found with device name hda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] No VIF found with MAC fa:16:3e:6c:e7:43, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ac185-2c13-45f5-8104-6701813eda0f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e, portal: 172.16.0.220,3260]
Aug 17 08:16:49 user nova-compute[72998]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e, portal: 172.16.0.220,3260] successful.
Aug 17 08:16:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2df6740b-f127-4bd2-b248-3239664d764e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3163a-b096-4c40-8be5-496c41e15e90]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.614s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] <== disconnect_volume: return (627ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:16:49 user nova-compute[72998]: INFO nova.virt.block_device [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Attempting to driver detach volume 140b6cf4-1e7d-490b-83f7-ab027421866a from mountpoint /dev/sdc
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Attempting to detach device sdc from instance a06900f6-a39f-422f-a7c3-c89e1574602b from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:16:49 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:49 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:16:49 user nova-compute[72998]:   <target dev="sdc" bus="scsi"/>
Aug 17 08:16:49 user nova-compute[72998]:   <serial>140b6cf4-1e7d-490b-83f7-ab027421866a</serial>
Aug 17 08:16:49 user nova-compute[72998]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 08:16:49 user nova-compute[72998]: </disk>
Aug 17 08:16:49 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:16:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Successfully detached device sdc from instance a06900f6-a39f-422f-a7c3-c89e1574602b from the persistent domain config.
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance a06900f6-a39f-422f-a7c3-c89e1574602b from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:16:49 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:49 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:16:49 user nova-compute[72998]:   <target dev="sdc" bus="scsi"/>
Aug 17 08:16:49 user nova-compute[72998]:   <serial>140b6cf4-1e7d-490b-83f7-ab027421866a</serial>
Aug 17 08:16:49 user nova-compute[72998]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 08:16:49 user nova-compute[72998]: </disk>
Aug 17 08:16:49 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260209.7917876, a06900f6-a39f-422f-a7c3-c89e1574602b => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance a06900f6-a39f-422f-a7c3-c89e1574602b {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:16:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Successfully detached device sdc from instance a06900f6-a39f-422f-a7c3-c89e1574602b from the live domain config.
Aug 17 08:16:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHUAtqJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:49 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c9a9d-1647-4022-93ce-83da2834bf85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c959540-1344-43b6-a434-0c614fcbb397]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:49 user nova-compute[72998]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)
Aug 17 08:16:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a (non-flash)
Aug 17 08:16:49 user nova-compute[72998]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)
Aug 17 08:16:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488268160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[887ea115-0fe1-467c-816b-68325aaed535]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd3cff1-f127-426d-bf20-52553fefe159]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ed9396-57de-4a36-b831-c325cb463c06]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4478aef2-f02f-4ca3-a7f1-721217a97573]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4346aa8f-75b7-42c5-aa90-7b1fb2de90ca]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[972c63d6-47fc-44f4-ade3-c1b3f05d8360]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a, portal: 172.16.0.220,3260]
Aug 17 08:16:50 user nova-compute[72998]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a, portal: 172.16.0.220,3260] successful.
Aug 17 08:16:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140b6cf4-1e7d-490b-83f7-ab027421866a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca45b11e-079f-4c80-a894-d042a0becb96]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] <== disconnect_volume: return (283ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG nova.objects.instance [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lazy-loading 'flavor' on Instance uuid ffb74821-5eff-4099-8bb6-d35d33ad1b87 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0127be05-c030-4413-b981-4305ccf6a648 tempest-VolumesAssistedSnapshotsTest-559485293 tempest-VolumesAssistedSnapshotsTest-559485293-project-admin] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.219s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae5def56-284d-49e6-bcbd-701013fc63d4 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.795s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260195.9488425, 1178b496-7709-411f-a789-766d6eea004b => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:16:50 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 1178b496-7709-411f-a789-766d6eea004b] VM Stopped (Lifecycle Event)
Aug 17 08:16:50 user nova-compute[72998]: DEBUG nova.compute.manager [None req-c7ab35d5-5395-4a39-9b72-3b67167130ea None None] [instance: 1178b496-7709-411f-a789-766d6eea004b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:16:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG nova.objects.instance [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lazy-loading 'flavor' on Instance uuid a06900f6-a39f-422f-a7c3-c89e1574602b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-55d2f854-7ba5-4d43-915a-52b364fb8385 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.005s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:51 user nova-compute[72998]: INFO nova.compute.manager [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Terminating instance
Aug 17 08:16:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:52 user nova-compute[72998]: INFO nova.compute.manager [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Detaching volume 716d1e80-e6a1-401f-bb39-8205f62ef181
Aug 17 08:16:52 user nova-compute[72998]: INFO nova.virt.block_device [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Attempting to driver detach volume 716d1e80-e6a1-401f-bb39-8205f62ef181 from mountpoint /dev/vdb
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Attempting to detach device vdb from instance e087f5bf-889a-462d-a412-4a39e829f6ec from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:16:52 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:52 user nova-compute[72998]:   <source dev="/dev/sdd"/>
Aug 17 08:16:52 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:16:52 user nova-compute[72998]:   <serial>716d1e80-e6a1-401f-bb39-8205f62ef181</serial>
Aug 17 08:16:52 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 08:16:52 user nova-compute[72998]: </disk>
Aug 17 08:16:52 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:16:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Successfully detached device vdb from instance e087f5bf-889a-462d-a412-4a39e829f6ec from the persistent domain config.
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e087f5bf-889a-462d-a412-4a39e829f6ec from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:16:52 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:16:52 user nova-compute[72998]:   <source dev="/dev/sdd"/>
Aug 17 08:16:52 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:16:52 user nova-compute[72998]:   <serial>716d1e80-e6a1-401f-bb39-8205f62ef181</serial>
Aug 17 08:16:52 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 08:16:52 user nova-compute[72998]: </disk>
Aug 17 08:16:52 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-c776bef6-18c3-405f-b8ce-fe48fc956bdc req-740a6a6c-54ff-456c-8867-6b8c53992ccf service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received event network-vif-unplugged-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c776bef6-18c3-405f-b8ce-fe48fc956bdc req-740a6a6c-54ff-456c-8867-6b8c53992ccf service nova] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c776bef6-18c3-405f-b8ce-fe48fc956bdc req-740a6a6c-54ff-456c-8867-6b8c53992ccf service nova] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c776bef6-18c3-405f-b8ce-fe48fc956bdc req-740a6a6c-54ff-456c-8867-6b8c53992ccf service nova] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-c776bef6-18c3-405f-b8ce-fe48fc956bdc req-740a6a6c-54ff-456c-8867-6b8c53992ccf service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] No waiting events found dispatching network-vif-unplugged-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-c776bef6-18c3-405f-b8ce-fe48fc956bdc req-740a6a6c-54ff-456c-8867-6b8c53992ccf service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received event network-vif-unplugged-10a46c87-9138-48a8-8228-2bf4501448b1 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260212.9045224, e087f5bf-889a-462d-a412-4a39e829f6ec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:16:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Successfully detached device vdb from instance e087f5bf-889a-462d-a412-4a39e829f6ec from the live domain config.
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XSbCLYHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:16:52 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:16:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Instance destroyed successfully.
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lazy-loading 'resources' on Instance uuid a06900f6-a39f-422f-a7c3-c89e1574602b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1065149419',display_name='tempest-AttachSCSIVolumeTestJSON-server-1065149419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1065149419',id=7,image_ref='17954092-02cf-4e7c-9f84-8786cce2ff8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOysBq+K048C4j2VVqrIk5CH/b3KupNMLTo5FXvyR3pOhildZa/ugeNsN4gcF8Wa2gsfT2ney7uR7jVcgVG2Uu+T/Axo/l7AeWGmked+85R/t6C6xovoSrrRDSemJGWFkA==',key_name='tempest-keypair-890772771',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='189a8d5df1724c5799dafc741f135973',ramdisk_id='',reservation_id='r-plzdhemg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17954092-02cf-4e7c-9f84-8786cce2ff8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-627924396',owner_user_name='tempest-AttachSCSIVolumeTestJSON-627924396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6bb04fc09a44f4984fcafe9a36a5697',uuid=a06900f6-a39f-422f-a7c3-c89e1574602b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Converting VIF {"id": "10a46c87-9138-48a8-8228-2bf4501448b1", "address": "fa:16:3e:0d:94:99", "network": {"id": "cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-733635529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189a8d5df1724c5799dafc741f135973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a46c87-91", "ovs_interfaceid": "10a46c87-9138-48a8-8228-2bf4501448b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=10a46c87-9138-48a8-8228-2bf4501448b1,network=Network(cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a46c87-91') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG os_vif [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=10a46c87-9138-48a8-8228-2bf4501448b1,network=Network(cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a46c87-91') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32b37aa-daaf-40c3-ba8c-33a368e17bda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10a46c87-91, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:16:52 user nova-compute[72998]: INFO os_vif [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:94:99,bridge_name='br-int',has_traffic_filtering=True,id=10a46c87-9138-48a8-8228-2bf4501448b1,network=Network(cfc65dc6-3a89-4cf0-b3fd-0a9405bcdda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a46c87-91')
Aug 17 08:16:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Deleting instance files /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b_del
Aug 17 08:16:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Deletion of /opt/stack/data/nova/instances/a06900f6-a39f-422f-a7c3-c89e1574602b_del complete
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[67855bc4-1f04-4792-b220-f342ff369312]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)
Aug 17 08:16:52 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 (non-flash)
Aug 17 08:16:52 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488575bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181'): ({'sdd'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Removing single pathed devices sdd {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:16:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d240f3-7be9-4409-a0a9-7e219ef79802]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc41b3b-e7aa-448c-af80-bde3b5d52ca7]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Flushing IO for device /dev/sdd {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[db490cb4-fef0-4885-9723-7f7058345b56]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:53 user nova-compute[72998]: INFO nova.compute.manager [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[546ccb4a-916b-4281-8d48-b869f756c230]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c44bee4-3cd1-4a9a-8b53-08d204838485]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94d9ba8-975b-42fd-884b-efd11afa2f22]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181, portal: 172.16.0.220,3260]
Aug 17 08:16:53 user nova-compute[72998]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181, portal: 172.16.0.220,3260] successful.
Aug 17 08:16:53 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:716d1e80-e6a1-401f-bb39-8205f62ef181 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ee6897-cc9c-4817-92b2-dbf9161a6079]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] <== disconnect_volume: return (302ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:16:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lazy-loading 'flavor' on Instance uuid e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c1e00e75-8226-42c1-89c1-febe0f95f73e tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.050s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-0b031e5c-b0d8-42b7-9472-b3fadea75c35 req-468001ea-79d2-43e1-a36d-48819e9146b2 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received event network-vif-plugged-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0b031e5c-b0d8-42b7-9472-b3fadea75c35 req-468001ea-79d2-43e1-a36d-48819e9146b2 service nova] Acquiring lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0b031e5c-b0d8-42b7-9472-b3fadea75c35 req-468001ea-79d2-43e1-a36d-48819e9146b2 service nova] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0b031e5c-b0d8-42b7-9472-b3fadea75c35 req-468001ea-79d2-43e1-a36d-48819e9146b2 service nova] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-0b031e5c-b0d8-42b7-9472-b3fadea75c35 req-468001ea-79d2-43e1-a36d-48819e9146b2 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] No waiting events found dispatching network-vif-plugged-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:54 user nova-compute[72998]: WARNING nova.compute.manager [req-0b031e5c-b0d8-42b7-9472-b3fadea75c35 req-468001ea-79d2-43e1-a36d-48819e9146b2 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received unexpected event network-vif-plugged-10a46c87-9138-48a8-8228-2bf4501448b1 for instance with vm_state active and task_state deleting.
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-ce01dd9e-a633-4e0c-a976-d1e7cb28167b req-6118d286-2dda-40be-93b9-04e5b40df3f4 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Received event network-vif-deleted-10a46c87-9138-48a8-8228-2bf4501448b1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:54 user nova-compute[72998]: INFO nova.compute.manager [req-ce01dd9e-a633-4e0c-a976-d1e7cb28167b req-6118d286-2dda-40be-93b9-04e5b40df3f4 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Neutron deleted interface 10a46c87-9138-48a8-8228-2bf4501448b1; detaching it from the instance and deleting it from the info cache
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-ce01dd9e-a633-4e0c-a976-d1e7cb28167b req-6118d286-2dda-40be-93b9-04e5b40df3f4 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:54 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Took 1.29 seconds to deallocate network for instance.
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "interface-e087f5bf-889a-462d-a412-4a39e829f6ec-80262617-85f7-4207-abd3-0ce52525fa96" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "interface-e087f5bf-889a-462d-a412-4a39e829f6ec-80262617-85f7-4207-abd3-0ce52525fa96" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-ce01dd9e-a633-4e0c-a976-d1e7cb28167b req-6118d286-2dda-40be-93b9-04e5b40df3f4 service nova] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Detach interface failed, port_id=10a46c87-9138-48a8-8228-2bf4501448b1, reason: Instance a06900f6-a39f-422f-a7c3-c89e1574602b could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lazy-loading 'flavor' on Instance uuid e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900252933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900252933',id=8,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVTnC3gnP971i31Ttky/4Xg/EnkXcozD7zi9pP8iuMWUahf+05KbIMa109iWM3ukXkgnqBJa6j0JfmxF37zj1tzySFuAQ4DGs1cYm513zaFxLSVFwigoX2hV94IwNMXxg==',key_name='tempest-keypair-1262423847',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9985c560f34f4991b6cb938d8b6fcd57',ramdisk_id='',reservation_id='r-3vy0dn1m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1304973980',owner_user_name='tempest-TaggedAttachmentsTest-1304973980-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14c6925b804342b7bee762e57a0fe9a1',uuid=e087f5bf-889a-462d-a412-4a39e829f6ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converting VIF {"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:9a:23,bridge_name='br-int',has_traffic_filtering=True,id=80262617-85f7-4207-abd3-0ce52525fa96,network=Network(fabf1d10-28f1-447b-b7c0-86ecb5554324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80262617-85') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:9a:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap80262617-85"/></interface> {{(pid=72998) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:9a:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap80262617-85"/></interface> {{(pid=72998) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Attempting to detach device tap80262617-85 from instance e087f5bf-889a-462d-a412-4a39e829f6ec from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] detach device xml: <interface type="ethernet">
Aug 17 08:16:54 user nova-compute[72998]:   <mac address="fa:16:3e:42:9a:23"/>
Aug 17 08:16:54 user nova-compute[72998]:   <model type="virtio"/>
Aug 17 08:16:54 user nova-compute[72998]:   <mtu size="1442"/>
Aug 17 08:16:54 user nova-compute[72998]:   <target dev="tap80262617-85"/>
Aug 17 08:16:54 user nova-compute[72998]: </interface>
Aug 17 08:16:54 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:9a:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap80262617-85"/></interface> {{(pid=72998) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:42:9a:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap80262617-85"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 17 08:16:54 user nova-compute[72998]:   <name>instance-00000008</name>
Aug 17 08:16:54 user nova-compute[72998]:   <uuid>e087f5bf-889a-462d-a412-4a39e829f6ec</uuid>
Aug 17 08:16:54 user nova-compute[72998]:   <metadata>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:16:54 user nova-compute[72998]:   <nova:package version="0.0.0"/>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:name>tempest-device-tagging-server-900252933</nova:name>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:creationTime>2023-08-17 08:16:34</nova:creationTime>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:flavor name="m1.tiny">
Aug 17 08:16:54 user nova-compute[72998]:     <nova:memory>512</nova:memory>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:disk>1</nova:disk>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:swap>0</nova:swap>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:vcpus>1</nova:vcpus>
Aug 17 08:16:54 user nova-compute[72998]:   </nova:flavor>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:owner>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:user uuid="14c6925b804342b7bee762e57a0fe9a1">tempest-TaggedAttachmentsTest-1304973980-project-member</nova:user>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:project uuid="9985c560f34f4991b6cb938d8b6fcd57">tempest-TaggedAttachmentsTest-1304973980</nova:project>
Aug 17 08:16:54 user nova-compute[72998]:   </nova:owner>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:ports>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:port uuid="76ac8bc8-ccbc-42fd-8caa-5c01cad6148f">
Aug 17 08:16:54 user nova-compute[72998]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:16:54 user nova-compute[72998]:     </nova:port>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:port uuid="80262617-85f7-4207-abd3-0ce52525fa96">
Aug 17 08:16:54 user nova-compute[72998]:       <nova:ip type="fixed" address="10.10.10.147" ipVersion="4"/>
Aug 17 08:16:54 user nova-compute[72998]:     </nova:port>
Aug 17 08:16:54 user nova-compute[72998]:   </nova:ports>
Aug 17 08:16:54 user nova-compute[72998]: </nova:instance>
Aug 17 08:16:54 user nova-compute[72998]:   </metadata>
Aug 17 08:16:54 user nova-compute[72998]:   <memory unit='KiB'>524288</memory>
Aug 17 08:16:54 user nova-compute[72998]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 08:16:54 user nova-compute[72998]:   <vcpu placement='static'>1</vcpu>
Aug 17 08:16:54 user nova-compute[72998]:   <resource>
Aug 17 08:16:54 user nova-compute[72998]:     <partition>/machine</partition>
Aug 17 08:16:54 user nova-compute[72998]:   </resource>
Aug 17 08:16:54 user nova-compute[72998]:   <sysinfo type='smbios'>
Aug 17 08:16:54 user nova-compute[72998]:     <system>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='version'>0.0.0</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='serial'>e087f5bf-889a-462d-a412-4a39e829f6ec</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='uuid'>e087f5bf-889a-462d-a412-4a39e829f6ec</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='family'>Virtual Machine</entry>
Aug 17 08:16:54 user nova-compute[72998]:     </system>
Aug 17 08:16:54 user nova-compute[72998]:   </sysinfo>
Aug 17 08:16:54 user nova-compute[72998]:   <os>
Aug 17 08:16:54 user nova-compute[72998]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 08:16:54 user nova-compute[72998]:     <boot dev='hd'/>
Aug 17 08:16:54 user nova-compute[72998]:     <smbios mode='sysinfo'/>
Aug 17 08:16:54 user nova-compute[72998]:   </os>
Aug 17 08:16:54 user nova-compute[72998]:   <features>
Aug 17 08:16:54 user nova-compute[72998]:     <acpi/>
Aug 17 08:16:54 user nova-compute[72998]:     <apic/>
Aug 17 08:16:54 user nova-compute[72998]:     <vmcoreinfo state='on'/>
Aug 17 08:16:54 user nova-compute[72998]:   </features>
Aug 17 08:16:54 user nova-compute[72998]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 08:16:54 user nova-compute[72998]:     <model fallback='forbid'>Nehalem</model>
Aug 17 08:16:54 user nova-compute[72998]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 08:16:54 user nova-compute[72998]:     <feature policy='require' name='vme'/>
Aug 17 08:16:54 user nova-compute[72998]:     <feature policy='require' name='x2apic'/>
Aug 17 08:16:54 user nova-compute[72998]:     <feature policy='require' name='hypervisor'/>
Aug 17 08:16:54 user nova-compute[72998]:   </cpu>
Aug 17 08:16:54 user nova-compute[72998]:   <clock offset='utc'>
Aug 17 08:16:54 user nova-compute[72998]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 08:16:54 user nova-compute[72998]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 08:16:54 user nova-compute[72998]:     <timer name='hpet' present='no'/>
Aug 17 08:16:54 user nova-compute[72998]:   </clock>
Aug 17 08:16:54 user nova-compute[72998]:   <on_poweroff>destroy</on_poweroff>
Aug 17 08:16:54 user nova-compute[72998]:   <on_reboot>restart</on_reboot>
Aug 17 08:16:54 user nova-compute[72998]:   <on_crash>destroy</on_crash>
Aug 17 08:16:54 user nova-compute[72998]:   <devices>
Aug 17 08:16:54 user nova-compute[72998]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 08:16:54 user nova-compute[72998]:     <disk type='file' device='disk'>
Aug 17 08:16:54 user nova-compute[72998]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 08:16:54 user nova-compute[72998]:       <source file='/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk' index='2'/>
Aug 17 08:16:54 user nova-compute[72998]:       <backingStore type='file' index='3'>
Aug 17 08:16:54 user nova-compute[72998]:         <format type='raw'/>
Aug 17 08:16:54 user nova-compute[72998]:         <source file='/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269'/>
Aug 17 08:16:54 user nova-compute[72998]:         <backingStore/>
Aug 17 08:16:54 user nova-compute[72998]:       </backingStore>
Aug 17 08:16:54 user nova-compute[72998]:       <target dev='vda' bus='virtio'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='virtio-disk0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </disk>
Aug 17 08:16:54 user nova-compute[72998]:     <disk type='file' device='cdrom'>
Aug 17 08:16:54 user nova-compute[72998]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 08:16:54 user nova-compute[72998]:       <source file='/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk.config' index='1'/>
Aug 17 08:16:54 user nova-compute[72998]:       <backingStore/>
Aug 17 08:16:54 user nova-compute[72998]:       <target dev='hda' bus='ide'/>
Aug 17 08:16:54 user nova-compute[72998]:       <readonly/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='ide0-0-0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </disk>
Aug 17 08:16:54 user nova-compute[72998]:     <controller type='usb' index='0' model='none'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='usb'/>
Aug 17 08:16:54 user nova-compute[72998]:     </controller>
Aug 17 08:16:54 user nova-compute[72998]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='pci.0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </controller>
Aug 17 08:16:54 user nova-compute[72998]:     <controller type='ide' index='0'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='ide'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 08:16:54 user nova-compute[72998]:     </controller>
Aug 17 08:16:54 user nova-compute[72998]:     <interface type='ethernet'>
Aug 17 08:16:54 user nova-compute[72998]:       <mac address='fa:16:3e:6c:e7:43'/>
Aug 17 08:16:54 user nova-compute[72998]:       <target dev='tap76ac8bc8-cc'/>
Aug 17 08:16:54 user nova-compute[72998]:       <model type='virtio'/>
Aug 17 08:16:54 user nova-compute[72998]:       <mtu size='1442'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='net0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </interface>
Aug 17 08:16:54 user nova-compute[72998]:     <interface type='ethernet'>
Aug 17 08:16:54 user nova-compute[72998]:       <mac address='fa:16:3e:42:9a:23'/>
Aug 17 08:16:54 user nova-compute[72998]:       <target dev='tap80262617-85'/>
Aug 17 08:16:54 user nova-compute[72998]:       <model type='virtio'/>
Aug 17 08:16:54 user nova-compute[72998]:       <mtu size='1442'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='net1'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </interface>
Aug 17 08:16:54 user nova-compute[72998]:     <serial type='pty'>
Aug 17 08:16:54 user nova-compute[72998]:       <source path='/dev/pts/7'/>
Aug 17 08:16:54 user nova-compute[72998]:       <log file='/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/console.log' append='off'/>
Aug 17 08:16:54 user nova-compute[72998]:       <target type='isa-serial' port='0'>
Aug 17 08:16:54 user nova-compute[72998]:         <model name='isa-serial'/>
Aug 17 08:16:54 user nova-compute[72998]:       </target>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='serial0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </serial>
Aug 17 08:16:54 user nova-compute[72998]:     <console type='pty' tty='/dev/pts/7'>
Aug 17 08:16:54 user nova-compute[72998]:       <source path='/dev/pts/7'/>
Aug 17 08:16:54 user nova-compute[72998]:       <log file='/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/console.log' append='off'/>
Aug 17 08:16:54 user nova-compute[72998]:       <target type='serial' port='0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='serial0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </console>
Aug 17 08:16:54 user nova-compute[72998]:     <input type='mouse' bus='ps2'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='input0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </input>
Aug 17 08:16:54 user nova-compute[72998]:     <input type='keyboard' bus='ps2'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='input1'/>
Aug 17 08:16:54 user nova-compute[72998]:     </input>
Aug 17 08:16:54 user nova-compute[72998]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 17 08:16:54 user nova-compute[72998]:       <listen type='address' address='0.0.0.0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </graphics>
Aug 17 08:16:54 user nova-compute[72998]:     <audio id='1' type='none'/>
Aug 17 08:16:54 user nova-compute[72998]:     <video>
Aug 17 08:16:54 user nova-compute[72998]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='video0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </video>
Aug 17 08:16:54 user nova-compute[72998]:     <memballoon model='virtio'>
Aug 17 08:16:54 user nova-compute[72998]:       <stats period='10'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='balloon0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </memballoon>
Aug 17 08:16:54 user nova-compute[72998]:     <rng model='virtio'>
Aug 17 08:16:54 user nova-compute[72998]:       <backend model='random'>/dev/urandom</backend>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='rng0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </rng>
Aug 17 08:16:54 user nova-compute[72998]:   </devices>
Aug 17 08:16:54 user nova-compute[72998]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 08:16:54 user nova-compute[72998]:     <label>libvirt-e087f5bf-889a-462d-a412-4a39e829f6ec</label>
Aug 17 08:16:54 user nova-compute[72998]:     <imagelabel>libvirt-e087f5bf-889a-462d-a412-4a39e829f6ec</imagelabel>
Aug 17 08:16:54 user nova-compute[72998]:   </seclabel>
Aug 17 08:16:54 user nova-compute[72998]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 08:16:54 user nova-compute[72998]:     <label>+64055:+108</label>
Aug 17 08:16:54 user nova-compute[72998]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 08:16:54 user nova-compute[72998]:   </seclabel>
Aug 17 08:16:54 user nova-compute[72998]: </domain>
Aug 17 08:16:54 user nova-compute[72998]:  {{(pid=72998) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 08:16:54 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Successfully detached device tap80262617-85 from instance e087f5bf-889a-462d-a412-4a39e829f6ec from the persistent domain config.
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] (1/8): Attempting to detach device tap80262617-85 with device alias net1 from instance e087f5bf-889a-462d-a412-4a39e829f6ec from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] detach device xml: <interface type="ethernet">
Aug 17 08:16:54 user nova-compute[72998]:   <mac address="fa:16:3e:42:9a:23"/>
Aug 17 08:16:54 user nova-compute[72998]:   <model type="virtio"/>
Aug 17 08:16:54 user nova-compute[72998]:   <mtu size="1442"/>
Aug 17 08:16:54 user nova-compute[72998]:   <target dev="tap80262617-85"/>
Aug 17 08:16:54 user nova-compute[72998]: </interface>
Aug 17 08:16:54 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:54 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Deleted allocations for instance a06900f6-a39f-422f-a7c3-c89e1574602b
Aug 17 08:16:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260214.8450024, e087f5bf-889a-462d-a412-4a39e829f6ec => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Start waiting for the detach event from libvirt for device tap80262617-85 with device alias net1 for instance e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:42:9a:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap80262617-85"/></interface> {{(pid=72998) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:42:9a:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap80262617-85"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 17 08:16:54 user nova-compute[72998]:   <name>instance-00000008</name>
Aug 17 08:16:54 user nova-compute[72998]:   <uuid>e087f5bf-889a-462d-a412-4a39e829f6ec</uuid>
Aug 17 08:16:54 user nova-compute[72998]:   <metadata>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:16:54 user nova-compute[72998]:   <nova:package version="0.0.0"/>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:name>tempest-device-tagging-server-900252933</nova:name>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:creationTime>2023-08-17 08:16:34</nova:creationTime>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:flavor name="m1.tiny">
Aug 17 08:16:54 user nova-compute[72998]:     <nova:memory>512</nova:memory>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:disk>1</nova:disk>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:swap>0</nova:swap>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:vcpus>1</nova:vcpus>
Aug 17 08:16:54 user nova-compute[72998]:   </nova:flavor>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:owner>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:user uuid="14c6925b804342b7bee762e57a0fe9a1">tempest-TaggedAttachmentsTest-1304973980-project-member</nova:user>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:project uuid="9985c560f34f4991b6cb938d8b6fcd57">tempest-TaggedAttachmentsTest-1304973980</nova:project>
Aug 17 08:16:54 user nova-compute[72998]:   </nova:owner>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:ports>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:port uuid="76ac8bc8-ccbc-42fd-8caa-5c01cad6148f">
Aug 17 08:16:54 user nova-compute[72998]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:16:54 user nova-compute[72998]:     </nova:port>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:port uuid="80262617-85f7-4207-abd3-0ce52525fa96">
Aug 17 08:16:54 user nova-compute[72998]:       <nova:ip type="fixed" address="10.10.10.147" ipVersion="4"/>
Aug 17 08:16:54 user nova-compute[72998]:     </nova:port>
Aug 17 08:16:54 user nova-compute[72998]:   </nova:ports>
Aug 17 08:16:54 user nova-compute[72998]: </nova:instance>
Aug 17 08:16:54 user nova-compute[72998]:   </metadata>
Aug 17 08:16:54 user nova-compute[72998]:   <memory unit='KiB'>524288</memory>
Aug 17 08:16:54 user nova-compute[72998]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 08:16:54 user nova-compute[72998]:   <vcpu placement='static'>1</vcpu>
Aug 17 08:16:54 user nova-compute[72998]:   <resource>
Aug 17 08:16:54 user nova-compute[72998]:     <partition>/machine</partition>
Aug 17 08:16:54 user nova-compute[72998]:   </resource>
Aug 17 08:16:54 user nova-compute[72998]:   <sysinfo type='smbios'>
Aug 17 08:16:54 user nova-compute[72998]:     <system>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='version'>0.0.0</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='serial'>e087f5bf-889a-462d-a412-4a39e829f6ec</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='uuid'>e087f5bf-889a-462d-a412-4a39e829f6ec</entry>
Aug 17 08:16:54 user nova-compute[72998]:       <entry name='family'>Virtual Machine</entry>
Aug 17 08:16:54 user nova-compute[72998]:     </system>
Aug 17 08:16:54 user nova-compute[72998]:   </sysinfo>
Aug 17 08:16:54 user nova-compute[72998]:   <os>
Aug 17 08:16:54 user nova-compute[72998]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 08:16:54 user nova-compute[72998]:     <boot dev='hd'/>
Aug 17 08:16:54 user nova-compute[72998]:     <smbios mode='sysinfo'/>
Aug 17 08:16:54 user nova-compute[72998]:   </os>
Aug 17 08:16:54 user nova-compute[72998]:   <features>
Aug 17 08:16:54 user nova-compute[72998]:     <acpi/>
Aug 17 08:16:54 user nova-compute[72998]:     <apic/>
Aug 17 08:16:54 user nova-compute[72998]:     <vmcoreinfo state='on'/>
Aug 17 08:16:54 user nova-compute[72998]:   </features>
Aug 17 08:16:54 user nova-compute[72998]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 08:16:54 user nova-compute[72998]:     <model fallback='forbid'>Nehalem</model>
Aug 17 08:16:54 user nova-compute[72998]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 08:16:54 user nova-compute[72998]:     <feature policy='require' name='vme'/>
Aug 17 08:16:54 user nova-compute[72998]:     <feature policy='require' name='x2apic'/>
Aug 17 08:16:54 user nova-compute[72998]:     <feature policy='require' name='hypervisor'/>
Aug 17 08:16:54 user nova-compute[72998]:   </cpu>
Aug 17 08:16:54 user nova-compute[72998]:   <clock offset='utc'>
Aug 17 08:16:54 user nova-compute[72998]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 08:16:54 user nova-compute[72998]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 08:16:54 user nova-compute[72998]:     <timer name='hpet' present='no'/>
Aug 17 08:16:54 user nova-compute[72998]:   </clock>
Aug 17 08:16:54 user nova-compute[72998]:   <on_poweroff>destroy</on_poweroff>
Aug 17 08:16:54 user nova-compute[72998]:   <on_reboot>restart</on_reboot>
Aug 17 08:16:54 user nova-compute[72998]:   <on_crash>destroy</on_crash>
Aug 17 08:16:54 user nova-compute[72998]:   <devices>
Aug 17 08:16:54 user nova-compute[72998]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 08:16:54 user nova-compute[72998]:     <disk type='file' device='disk'>
Aug 17 08:16:54 user nova-compute[72998]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 08:16:54 user nova-compute[72998]:       <source file='/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk' index='2'/>
Aug 17 08:16:54 user nova-compute[72998]:       <backingStore type='file' index='3'>
Aug 17 08:16:54 user nova-compute[72998]:         <format type='raw'/>
Aug 17 08:16:54 user nova-compute[72998]:         <source file='/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269'/>
Aug 17 08:16:54 user nova-compute[72998]:         <backingStore/>
Aug 17 08:16:54 user nova-compute[72998]:       </backingStore>
Aug 17 08:16:54 user nova-compute[72998]:       <target dev='vda' bus='virtio'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='virtio-disk0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </disk>
Aug 17 08:16:54 user nova-compute[72998]:     <disk type='file' device='cdrom'>
Aug 17 08:16:54 user nova-compute[72998]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 08:16:54 user nova-compute[72998]:       <source file='/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk.config' index='1'/>
Aug 17 08:16:54 user nova-compute[72998]:       <backingStore/>
Aug 17 08:16:54 user nova-compute[72998]:       <target dev='hda' bus='ide'/>
Aug 17 08:16:54 user nova-compute[72998]:       <readonly/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='ide0-0-0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </disk>
Aug 17 08:16:54 user nova-compute[72998]:     <controller type='usb' index='0' model='none'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='usb'/>
Aug 17 08:16:54 user nova-compute[72998]:     </controller>
Aug 17 08:16:54 user nova-compute[72998]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='pci.0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </controller>
Aug 17 08:16:54 user nova-compute[72998]:     <controller type='ide' index='0'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='ide'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 08:16:54 user nova-compute[72998]:     </controller>
Aug 17 08:16:54 user nova-compute[72998]:     <interface type='ethernet'>
Aug 17 08:16:54 user nova-compute[72998]:       <mac address='fa:16:3e:6c:e7:43'/>
Aug 17 08:16:54 user nova-compute[72998]:       <target dev='tap76ac8bc8-cc'/>
Aug 17 08:16:54 user nova-compute[72998]:       <model type='virtio'/>
Aug 17 08:16:54 user nova-compute[72998]:       <mtu size='1442'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='net0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </interface>
Aug 17 08:16:54 user nova-compute[72998]:     <serial type='pty'>
Aug 17 08:16:54 user nova-compute[72998]:       <source path='/dev/pts/7'/>
Aug 17 08:16:54 user nova-compute[72998]:       <log file='/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/console.log' append='off'/>
Aug 17 08:16:54 user nova-compute[72998]:       <target type='isa-serial' port='0'>
Aug 17 08:16:54 user nova-compute[72998]:         <model name='isa-serial'/>
Aug 17 08:16:54 user nova-compute[72998]:       </target>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='serial0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </serial>
Aug 17 08:16:54 user nova-compute[72998]:     <console type='pty' tty='/dev/pts/7'>
Aug 17 08:16:54 user nova-compute[72998]:       <source path='/dev/pts/7'/>
Aug 17 08:16:54 user nova-compute[72998]:       <log file='/opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/console.log' append='off'/>
Aug 17 08:16:54 user nova-compute[72998]:       <target type='serial' port='0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='serial0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </console>
Aug 17 08:16:54 user nova-compute[72998]:     <input type='mouse' bus='ps2'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='input0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </input>
Aug 17 08:16:54 user nova-compute[72998]:     <input type='keyboard' bus='ps2'>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='input1'/>
Aug 17 08:16:54 user nova-compute[72998]:     </input>
Aug 17 08:16:54 user nova-compute[72998]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 17 08:16:54 user nova-compute[72998]:       <listen type='address' address='0.0.0.0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </graphics>
Aug 17 08:16:54 user nova-compute[72998]:     <audio id='1' type='none'/>
Aug 17 08:16:54 user nova-compute[72998]:     <video>
Aug 17 08:16:54 user nova-compute[72998]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='video0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </video>
Aug 17 08:16:54 user nova-compute[72998]:     <memballoon model='virtio'>
Aug 17 08:16:54 user nova-compute[72998]:       <stats period='10'/>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='balloon0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </memballoon>
Aug 17 08:16:54 user nova-compute[72998]:     <rng model='virtio'>
Aug 17 08:16:54 user nova-compute[72998]:       <backend model='random'>/dev/urandom</backend>
Aug 17 08:16:54 user nova-compute[72998]:       <alias name='rng0'/>
Aug 17 08:16:54 user nova-compute[72998]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 08:16:54 user nova-compute[72998]:     </rng>
Aug 17 08:16:54 user nova-compute[72998]:   </devices>
Aug 17 08:16:54 user nova-compute[72998]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 08:16:54 user nova-compute[72998]:     <label>libvirt-e087f5bf-889a-462d-a412-4a39e829f6ec</label>
Aug 17 08:16:54 user nova-compute[72998]:     <imagelabel>libvirt-e087f5bf-889a-462d-a412-4a39e829f6ec</imagelabel>
Aug 17 08:16:54 user nova-compute[72998]:   </seclabel>
Aug 17 08:16:54 user nova-compute[72998]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 08:16:54 user nova-compute[72998]:     <label>+64055:+108</label>
Aug 17 08:16:54 user nova-compute[72998]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 08:16:54 user nova-compute[72998]:   </seclabel>
Aug 17 08:16:54 user nova-compute[72998]: </domain>
Aug 17 08:16:54 user nova-compute[72998]:  {{(pid=72998) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 08:16:54 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Successfully detached device tap80262617-85 from instance e087f5bf-889a-462d-a412-4a39e829f6ec from the live domain config.
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900252933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900252933',id=8,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVTnC3gnP971i31Ttky/4Xg/EnkXcozD7zi9pP8iuMWUahf+05KbIMa109iWM3ukXkgnqBJa6j0JfmxF37zj1tzySFuAQ4DGs1cYm513zaFxLSVFwigoX2hV94IwNMXxg==',key_name='tempest-keypair-1262423847',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9985c560f34f4991b6cb938d8b6fcd57',ramdisk_id='',reservation_id='r-3vy0dn1m',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1304973980',owner_user_name='tempest-TaggedAttachmentsTest-1304973980-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14c6925b804342b7bee762e57a0fe9a1',uuid=e087f5bf-889a-462d-a412-4a39e829f6ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converting VIF {"id": "80262617-85f7-4207-abd3-0ce52525fa96", "address": "fa:16:3e:42:9a:23", "network": {"id": "fabf1d10-28f1-447b-b7c0-86ecb5554324", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2032456156", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80262617-85", "ovs_interfaceid": "80262617-85f7-4207-abd3-0ce52525fa96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:9a:23,bridge_name='br-int',has_traffic_filtering=True,id=80262617-85f7-4207-abd3-0ce52525fa96,network=Network(fabf1d10-28f1-447b-b7c0-86ecb5554324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80262617-85') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG os_vif [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:9a:23,bridge_name='br-int',has_traffic_filtering=True,id=80262617-85f7-4207-abd3-0ce52525fa96,network=Network(fabf1d10-28f1-447b-b7c0-86ecb5554324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80262617-85') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80262617-85, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:54 user nova-compute[72998]: INFO os_vif [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:9a:23,bridge_name='br-int',has_traffic_filtering=True,id=80262617-85f7-4207-abd3-0ce52525fa96,network=Network(fabf1d10-28f1-447b-b7c0-86ecb5554324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80262617-85')
Aug 17 08:16:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:16:54 user nova-compute[72998]:   <nova:package version="0.0.0"/>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:name>tempest-device-tagging-server-900252933</nova:name>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:creationTime>2023-08-17 08:16:54</nova:creationTime>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:flavor name="m1.tiny">
Aug 17 08:16:54 user nova-compute[72998]:     <nova:memory>512</nova:memory>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:disk>1</nova:disk>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:swap>0</nova:swap>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:vcpus>1</nova:vcpus>
Aug 17 08:16:54 user nova-compute[72998]:   </nova:flavor>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:owner>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:user uuid="14c6925b804342b7bee762e57a0fe9a1">tempest-TaggedAttachmentsTest-1304973980-project-member</nova:user>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:project uuid="9985c560f34f4991b6cb938d8b6fcd57">tempest-TaggedAttachmentsTest-1304973980</nova:project>
Aug 17 08:16:54 user nova-compute[72998]:   </nova:owner>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:16:54 user nova-compute[72998]:   <nova:ports>
Aug 17 08:16:54 user nova-compute[72998]:     <nova:port uuid="76ac8bc8-ccbc-42fd-8caa-5c01cad6148f">
Aug 17 08:16:54 user nova-compute[72998]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:16:54 user nova-compute[72998]:     </nova:port>
Aug 17 08:16:54 user nova-compute[72998]:   </nova:ports>
Aug 17 08:16:54 user nova-compute[72998]: </nova:instance>
Aug 17 08:16:54 user nova-compute[72998]:  {{(pid=72998) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 08:16:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7735e707-1483-4837-96e3-5cb53db48da4 tempest-AttachSCSIVolumeTestJSON-627924396 tempest-AttachSCSIVolumeTestJSON-627924396-project-member] Lock "a06900f6-a39f-422f-a7c3-c89e1574602b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.096s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-03b7497a-87b7-426b-80a7-ec885266cd9d req-3e6be31f-d702-4511-b25d-7f35d4b4cb28 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-unplugged-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-03b7497a-87b7-426b-80a7-ec885266cd9d req-3e6be31f-d702-4511-b25d-7f35d4b4cb28 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-03b7497a-87b7-426b-80a7-ec885266cd9d req-3e6be31f-d702-4511-b25d-7f35d4b4cb28 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-03b7497a-87b7-426b-80a7-ec885266cd9d req-3e6be31f-d702-4511-b25d-7f35d4b4cb28 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-03b7497a-87b7-426b-80a7-ec885266cd9d req-3e6be31f-d702-4511-b25d-7f35d4b4cb28 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-unplugged-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:55 user nova-compute[72998]: WARNING nova.compute.manager [req-03b7497a-87b7-426b-80a7-ec885266cd9d req-3e6be31f-d702-4511-b25d-7f35d4b4cb28 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-unplugged-80262617-85f7-4207-abd3-0ce52525fa96 for instance with vm_state active and task_state None.
Aug 17 08:16:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:16:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquired lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:16:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:16:56 user nova-compute[72998]: INFO nova.network.neutron [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Port 80262617-85f7-4207-abd3-0ce52525fa96 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 17 08:16:56 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updating instance_info_cache with network_info: [{"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Releasing lock "refresh_cache-e087f5bf-889a-462d-a412-4a39e829f6ec" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:16:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a851ccd3-9814-4f87-96ba-883dbd7c2371 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "interface-e087f5bf-889a-462d-a412-4a39e829f6ec-80262617-85f7-4207-abd3-0ce52525fa96" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.843s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-a9b1f946-97fc-4cf4-8aca-274d76d97130 req-9723b090-dd5c-486b-b408-9a9bf6f7a9b6 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-deleted-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-61a7f0bf-aff9-40cf-9e75-986033d5c830 req-5bd92ee7-62bd-4954-8b9a-abefe58abe5c service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-plugged-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:16:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-61a7f0bf-aff9-40cf-9e75-986033d5c830 req-5bd92ee7-62bd-4954-8b9a-abefe58abe5c service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-61a7f0bf-aff9-40cf-9e75-986033d5c830 req-5bd92ee7-62bd-4954-8b9a-abefe58abe5c service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-61a7f0bf-aff9-40cf-9e75-986033d5c830 req-5bd92ee7-62bd-4954-8b9a-abefe58abe5c service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-61a7f0bf-aff9-40cf-9e75-986033d5c830 req-5bd92ee7-62bd-4954-8b9a-abefe58abe5c service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-plugged-80262617-85f7-4207-abd3-0ce52525fa96 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:16:57 user nova-compute[72998]: WARNING nova.compute.manager [req-61a7f0bf-aff9-40cf-9e75-986033d5c830 req-5bd92ee7-62bd-4954-8b9a-abefe58abe5c service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-plugged-80262617-85f7-4207-abd3-0ce52525fa96 for instance with vm_state active and task_state None.
Aug 17 08:16:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:16:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:16:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:16:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:16:57 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updating instance_info_cache with network_info: [{"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:16:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:16:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVRfmdKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:00 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:00 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:00 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[79433eb1-5b8e-4cb2-8bc7-632cb9b655d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:17:00 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e1bbf-1866-4338-b3b8-607adab34cc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a] added
Aug 17 08:17:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78b646e-a954-4b0a-a2ed-89826642604b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[153512cd-a684-4d76-9910-81837a2297e9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVRfmdKs {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVRfmdKs" returned: 0 in 0.041s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3c5471-1bfd-439a-a489-8197078fe703]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BVRfmdKs'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0e6029-a442-428f-bb81-ef66244280bb]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf13098-13fa-47a2-a1c0-5ca00a7d2b94]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:17:00 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:17:00 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:00 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:17:00 user nova-compute[72998]: 
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80dc044-7165-4c03-bb56-16f31f0a15cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260]
Aug 17 08:17:00 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260] successful.
Aug 17 08:17:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0996ef1b-c461-48c1-b13c-f339d8fa36d7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba177cee-7bae-4e0e-ac4d-cdc3f839a88c]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] HCTL ('33', '-', '-', 0) found on session 6 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[90544694-2595-4dc1-af4d-4f5e11fbbaf8]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Searching for a device in session 6 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVRfmdKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23661333131323766', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661333131323766', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lazy-loading 'flavor' on Instance uuid c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:17:01 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:17:01 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:17:01 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:17:01 user nova-compute[72998]:   <serial>e4228be6-ba70-4efe-b04d-e86a9d58368a</serial>
Aug 17 08:17:01 user nova-compute[72998]: </disk>
Aug 17 08:17:01 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] No VIF found with MAC fa:16:3e:25:50:ea, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7970dc22-0cda-4399-8f01-8b1b68d29ea0 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.025s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:02 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:17:02 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7581MB free_disk=24.556621551513672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ffb74821-5eff-4099-8bb6-d35d33ad1b87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e087f5bf-889a-462d-a412-4a39e829f6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:17:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG os_brick.utils [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58f0791-83e9-4e66-aaf0-67378423810a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bef02b-8060-426f-b01e-df5d0698bf77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f5c8a1-6457-4469-b560-598e132e0735]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d4a9f6-4e26-4963-bcf3-0fc14969d5a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:17:03 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:17:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[75266e50-9b4f-4940-a3fc-e64762a89f7f]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG os_brick.utils [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:03 user nova-compute[72998]: INFO nova.compute.manager [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Swapping volume e4228be6-ba70-4efe-b04d-e86a9d58368a for bd47e5c2-b4f9-4b89-aa01-b03987dad218
Aug 17 08:17:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:17:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:17:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:17:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:17:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:17:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:17:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:07 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260212.9253545, a06900f6-a39f-422f-a7c3-c89e1574602b => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:17:07 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] VM Stopped (Lifecycle Event)
Aug 17 08:17:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-11f6e8ec-31c4-4a35-9e12-f8fb9e60b177 None None] [instance: a06900f6-a39f-422f-a7c3-c89e1574602b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMyoHFLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:08 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:08 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:08 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc2427-ebef-4d17-9e4f-52b61ecdd3e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:17:08 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e2d58-d7da-44b0-a122-4614cbcf77e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08] added
Aug 17 08:17:08 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82ad11a-f9cb-435f-96d0-2fb6231509a8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a6d9eb-0bc0-4762-b470-16e1ddb9d60d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMyoHFLU {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMyoHFLU" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[be57280e-8885-4b56-bf01-eb9b2b5ab291]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMyoHFLU'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb097846-cc49-42a0-b809-8dd1229b1719]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99b56d5-a90b-46e8-81e4-f0918741b836]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:08 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:08 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5365b6-1586-403a-9b45-9778db61ac62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08, portal: 172.16.0.220,3260]
Aug 17 08:17:08 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08, portal: 172.16.0.220,3260] successful.
Aug 17 08:17:08 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20014d7-2659-4292-a433-bd13dd9dde5d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6293c3-41cf-44f1-8e75-4619eaab09da]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:08 user nova-compute[72998]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 (non-flash)
Aug 17 08:17:08 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:08 user nova-compute[72998]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 (non-flash)
Aug 17 08:17:08 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13c9746-cafa-4686-8678-ef8c95430eef]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:08 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:17:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:17:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMyoHFLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:17:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23865613230363862', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865613230363862', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:17:09 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lazy-loading 'flavor' on Instance uuid e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:17:09 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:17:09 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:17:09 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:17:09 user nova-compute[72998]:   <serial>af0fde0f-35a9-496f-bb24-0a3790f33e08</serial>
Aug 17 08:17:09 user nova-compute[72998]: </disk>
Aug 17 08:17:09 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:17:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:17:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:17:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] No VIF found with MAC fa:16:3e:1d:ef:ff, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:17:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b183c47a-ddbe-4754-9bfc-bc4c06e121f9 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.737s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:11 user nova-compute[72998]: INFO nova.compute.manager [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Detaching volume af0fde0f-35a9-496f-bb24-0a3790f33e08
Aug 17 08:17:12 user nova-compute[72998]: INFO nova.virt.block_device [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Attempting to driver detach volume af0fde0f-35a9-496f-bb24-0a3790f33e08 from mountpoint /dev/vdb
Aug 17 08:17:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Attempting to detach device vdb from instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:17:12 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:17:12 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:17:12 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:17:12 user nova-compute[72998]:   <serial>af0fde0f-35a9-496f-bb24-0a3790f33e08</serial>
Aug 17 08:17:12 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:17:12 user nova-compute[72998]: </disk>
Aug 17 08:17:12 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:17:12 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Successfully detached device vdb from instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 from the persistent domain config.
Aug 17 08:17:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:17:12 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:17:12 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:17:12 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:17:12 user nova-compute[72998]:   <serial>af0fde0f-35a9-496f-bb24-0a3790f33e08</serial>
Aug 17 08:17:12 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:17:12 user nova-compute[72998]: </disk>
Aug 17 08:17:12 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260232.4848118, e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:17:12 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Successfully detached device vdb from instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 from the live domain config.
Aug 17 08:17:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMyoHFLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:12 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8a6a0a-3083-48d5-a076-4fb8ad61bf90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d20aa75-8591-42f7-8cd2-ee34e3c7fd12]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:12 user nova-compute[72998]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 (non-flash)
Aug 17 08:17:12 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:12 user nova-compute[72998]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 (non-flash)
Aug 17 08:17:12 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488564d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2d765e-a8f7-4333-87c7-01f455ac63b2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[15040f68-83a0-48a8-a948-f955920e5fb8]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc8eac-ddb8-4e1d-aad4-9ff18fe0d723]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[641038a3-1713-4729-8dfd-df27f3a6eb48]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f61cbb7-2647-4421-bf6b-683414a43240]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7492333a-f16c-4ea7-9da6-638845b783e4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08, portal: 172.16.0.220,3260]
Aug 17 08:17:12 user nova-compute[72998]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08, portal: 172.16.0.220,3260] successful.
Aug 17 08:17:12 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af0fde0f-35a9-496f-bb24-0a3790f33e08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[06db67e6-cb28-4255-a046-349249d9c10c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] <== disconnect_volume: return (293ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:17:13 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lazy-loading 'flavor' on Instance uuid e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e1fab5e-62a7-4242-bf33-2a42a6a94c29 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:14 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:17:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:14 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:17:14 user nova-compute[72998]: INFO nova.compute.claims [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Claim successful on node user
Aug 17 08:17:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUTdEbvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3d1e35d-0cec-451b-b0b8-c51fbfd78c37', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd47e5c2-b4f9-4b89-aa01-b03987dad218', 'serial': 'bd47e5c2-b4f9-4b89-aa01-b03987dad218'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVRfmdKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c3d1e35d-0cec-451b-b0b8-c51fbfd78c37', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4228be6-ba70-4efe-b04d-e86a9d58368a', 'serial'} {{(pid=72998) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUTdEbvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:15 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:15 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:15 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[031ccc9d-0e41-4121-b162-ca092dd683b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:17:15 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1abc67-35e3-4e91-bb1f-a15ebf10760c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218] added
Aug 17 08:17:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d2a9fc-22b2-4010-a461-931072fe78b1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1939b77-3076-4341-978b-0bcc3d36a2f0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUTdEbvc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUTdEbvc" returned: 0 in 0.041s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd264da-b66a-4558-b60a-b18fac8ff8c1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUTdEbvc'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b400f140-d0f9-4754-b1aa-eb4e4427bc10]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d5f616-a881-4465-b5ae-99849d40a265]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e659a3b-f94a-4996-bab4-4fee5faef621]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218, portal: 172.16.0.220,3260]
Aug 17 08:17:15 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218, portal: 172.16.0.220,3260] successful.
Aug 17 08:17:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f59db0-88ec-4cc6-a865-a77006b85b3f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.policy [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39227b3a71d243a3acafa9317a45e691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f95e7d214049b3831b038a0f0c4d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3f9fa3-eb12-4a84-a122-f7f8f19a0b12]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:15 user nova-compute[72998]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:15 user nova-compute[72998]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] HCTL ('34', '-', '-', 0) found on session 8 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6e08c-27d2-4a55-a13d-1741c2d4ea21]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUTdEbvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:17:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Creating image(s)
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "/opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "/opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk 1073741824" returned: 0 in 0.053s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Cannot resize image /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'migration_context' on Instance uuid cfbd3131-e61b-45a4-8c69-91081320f046 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Ensure instance console log exists: /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Successfully created port: 85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23064366631306234', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064366631306234', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG nova.objects.instance [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lazy-loading 'flavor' on Instance uuid c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Successfully updated port: 85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquired lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-22fb419c-9a59-4a23-bf31-1d520acc4cf1 req-dabb8e77-6d9d-41ea-a1cc-7bd2f1e0a366 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received event network-changed-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-22fb419c-9a59-4a23-bf31-1d520acc4cf1 req-dabb8e77-6d9d-41ea-a1cc-7bd2f1e0a366 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Refreshing instance network info cache due to event network-changed-85f6bd9d-2413-407d-9172-9fd50266255a. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-22fb419c-9a59-4a23-bf31-1d520acc4cf1 req-dabb8e77-6d9d-41ea-a1cc-7bd2f1e0a366 service nova] Acquiring lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updating instance_info_cache with network_info: [{"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Releasing lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Instance network_info: |[{"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-22fb419c-9a59-4a23-bf31-1d520acc4cf1 req-dabb8e77-6d9d-41ea-a1cc-7bd2f1e0a366 service nova] Acquired lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.network.neutron [req-22fb419c-9a59-4a23-bf31-1d520acc4cf1 req-dabb8e77-6d9d-41ea-a1cc-7bd2f1e0a366 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Refreshing network info cache for port 85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Start _get_guest_xml network_info=[{"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:17:17 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:17:17 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-940523251',display_name='tempest-TestStampPattern-server-940523251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-940523251',id=11,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONZnqz4fz+N+JdDC9+VNVpRQxh6Mlne8ooU/TM1lcGerNueG6YDdZwYx4ZrGiVscocoQaLxw+uf1ndX7MqRoz/Bmg7lB1XGzA+NMiG3jzsbCxCIyBAvUWgKK/6+2DK/Eg==',key_name='tempest-TestStampPattern-1214740701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f95e7d214049b3831b038a0f0c4d8c',ramdisk_id='',reservation_id='r-g6hlot1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-795414078',owner_user_name='tempest-TestStampPattern-795414078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:17:15Z,user_data=None,user_id='39227b3a71d243a3acafa9317a45e691',uuid=cfbd3131-e61b-45a4-8c69-91081320f046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converting VIF {"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:3d:e0,bridge_name='br-int',has_traffic_filtering=True,id=85f6bd9d-2413-407d-9172-9fd50266255a,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6bd9d-24') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'pci_devices' on Instance uuid cfbd3131-e61b-45a4-8c69-91081320f046 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:17:17 user nova-compute[72998]:   <uuid>cfbd3131-e61b-45a4-8c69-91081320f046</uuid>
Aug 17 08:17:17 user nova-compute[72998]:   <name>instance-0000000b</name>
Aug 17 08:17:17 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:17:17 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:17:17 user nova-compute[72998]:   <metadata>
Aug 17 08:17:17 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:17:17 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:17:17 user nova-compute[72998]:       <nova:name>tempest-TestStampPattern-server-940523251</nova:name>
Aug 17 08:17:17 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:17:17</nova:creationTime>
Aug 17 08:17:17 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:17:17 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:17:17 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:17:17 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:17:17 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:17:17 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:17:17 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:17:17 user nova-compute[72998]:       <nova:owner>
Aug 17 08:17:17 user nova-compute[72998]:         <nova:user uuid="39227b3a71d243a3acafa9317a45e691">tempest-TestStampPattern-795414078-project-member</nova:user>
Aug 17 08:17:17 user nova-compute[72998]:         <nova:project uuid="74f95e7d214049b3831b038a0f0c4d8c">tempest-TestStampPattern-795414078</nova:project>
Aug 17 08:17:17 user nova-compute[72998]:       </nova:owner>
Aug 17 08:17:17 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:17:17 user nova-compute[72998]:       <nova:ports>
Aug 17 08:17:17 user nova-compute[72998]:         <nova:port uuid="85f6bd9d-2413-407d-9172-9fd50266255a">
Aug 17 08:17:17 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 08:17:17 user nova-compute[72998]:         </nova:port>
Aug 17 08:17:17 user nova-compute[72998]:       </nova:ports>
Aug 17 08:17:17 user nova-compute[72998]:     </nova:instance>
Aug 17 08:17:17 user nova-compute[72998]:   </metadata>
Aug 17 08:17:17 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:17:17 user nova-compute[72998]:     <system>
Aug 17 08:17:17 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:17:17 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:17:17 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:17:17 user nova-compute[72998]:       <entry name="serial">cfbd3131-e61b-45a4-8c69-91081320f046</entry>
Aug 17 08:17:17 user nova-compute[72998]:       <entry name="uuid">cfbd3131-e61b-45a4-8c69-91081320f046</entry>
Aug 17 08:17:17 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:17:17 user nova-compute[72998]:     </system>
Aug 17 08:17:17 user nova-compute[72998]:   </sysinfo>
Aug 17 08:17:17 user nova-compute[72998]:   <os>
Aug 17 08:17:17 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:17:17 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:17:17 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:17:17 user nova-compute[72998]:   </os>
Aug 17 08:17:17 user nova-compute[72998]:   <features>
Aug 17 08:17:17 user nova-compute[72998]:     <acpi/>
Aug 17 08:17:17 user nova-compute[72998]:     <apic/>
Aug 17 08:17:17 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:17:17 user nova-compute[72998]:   </features>
Aug 17 08:17:17 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:17:17 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:17:17 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:17:17 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:17:17 user nova-compute[72998]:   </clock>
Aug 17 08:17:17 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:17:17 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:17:17 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:17:17 user nova-compute[72998]:   </cpu>
Aug 17 08:17:17 user nova-compute[72998]:   <devices>
Aug 17 08:17:17 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:17:17 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:17:17 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk"/>
Aug 17 08:17:17 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:17:17 user nova-compute[72998]:     </disk>
Aug 17 08:17:17 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:17:17 user nova-compute[72998]:       <mac address="fa:16:3e:99:3d:e0"/>
Aug 17 08:17:17 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:17:17 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:17:17 user nova-compute[72998]:       <target dev="tap85f6bd9d-24"/>
Aug 17 08:17:17 user nova-compute[72998]:     </interface>
Aug 17 08:17:17 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:17:17 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/console.log" append="off"/>
Aug 17 08:17:17 user nova-compute[72998]:     </serial>
Aug 17 08:17:17 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:17:17 user nova-compute[72998]:     <video>
Aug 17 08:17:17 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:17:17 user nova-compute[72998]:     </video>
Aug 17 08:17:17 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:17:17 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:17:17 user nova-compute[72998]:     </rng>
Aug 17 08:17:17 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:17:17 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:17:17 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:17:17 user nova-compute[72998]:     </memballoon>
Aug 17 08:17:17 user nova-compute[72998]:   </devices>
Aug 17 08:17:17 user nova-compute[72998]: </domain>
Aug 17 08:17:17 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-940523251',display_name='tempest-TestStampPattern-server-940523251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-940523251',id=11,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONZnqz4fz+N+JdDC9+VNVpRQxh6Mlne8ooU/TM1lcGerNueG6YDdZwYx4ZrGiVscocoQaLxw+uf1ndX7MqRoz/Bmg7lB1XGzA+NMiG3jzsbCxCIyBAvUWgKK/6+2DK/Eg==',key_name='tempest-TestStampPattern-1214740701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f95e7d214049b3831b038a0f0c4d8c',ramdisk_id='',reservation_id='r-g6hlot1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-795414078',owner_user_name='tempest-TestStampPattern-795414078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:17:15Z,user_data=None,user_id='39227b3a71d243a3acafa9317a45e691',uuid=cfbd3131-e61b-45a4-8c69-91081320f046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converting VIF {"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:3d:e0,bridge_name='br-int',has_traffic_filtering=True,id=85f6bd9d-2413-407d-9172-9fd50266255a,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6bd9d-24') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG os_vif [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:3d:e0,bridge_name='br-int',has_traffic_filtering=True,id=85f6bd9d-2413-407d-9172-9fd50266255a,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6bd9d-24') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85f6bd9d-24, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85f6bd9d-24, col_values=(('external_ids', {'iface-id': '85f6bd9d-2413-407d-9172-9fd50266255a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:3d:e0', 'vm-uuid': 'cfbd3131-e61b-45a4-8c69-91081320f046'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:17 user nova-compute[72998]: INFO os_vif [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:3d:e0,bridge_name='br-int',has_traffic_filtering=True,id=85f6bd9d-2413-407d-9172-9fd50266255a,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6bd9d-24')
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No VIF found with MAC fa:16:3e:99:3d:e0, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:17:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 224395264 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-22fb419c-9a59-4a23-bf31-1d520acc4cf1 req-dabb8e77-6d9d-41ea-a1cc-7bd2f1e0a366 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updated VIF entry in instance network info cache for port 85f6bd9d-2413-407d-9172-9fd50266255a. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:17:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-22fb419c-9a59-4a23-bf31-1d520acc4cf1 req-dabb8e77-6d9d-41ea-a1cc-7bd2f1e0a366 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updating instance_info_cache with network_info: [{"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:17:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-22fb419c-9a59-4a23-bf31-1d520acc4cf1 req-dabb8e77-6d9d-41ea-a1cc-7bd2f1e0a366 service nova] Releasing lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:17:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 319815680 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 412090368 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 565182464 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 613416960 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-355bc4cd-f238-41c6-8b6d-f7426c6341b6 req-b08f36c8-ae1d-4999-ac40-ca13053c9887 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received event network-vif-plugged-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-355bc4cd-f238-41c6-8b6d-f7426c6341b6 req-b08f36c8-ae1d-4999-ac40-ca13053c9887 service nova] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-355bc4cd-f238-41c6-8b6d-f7426c6341b6 req-b08f36c8-ae1d-4999-ac40-ca13053c9887 service nova] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-355bc4cd-f238-41c6-8b6d-f7426c6341b6 req-b08f36c8-ae1d-4999-ac40-ca13053c9887 service nova] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-355bc4cd-f238-41c6-8b6d-f7426c6341b6 req-b08f36c8-ae1d-4999-ac40-ca13053c9887 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] No waiting events found dispatching network-vif-plugged-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:20 user nova-compute[72998]: WARNING nova.compute.manager [req-355bc4cd-f238-41c6-8b6d-f7426c6341b6 req-b08f36c8-ae1d-4999-ac40-ca13053c9887 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received unexpected event network-vif-plugged-85f6bd9d-2413-407d-9172-9fd50266255a for instance with vm_state building and task_state spawning.
Aug 17 08:17:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 758120448 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 879755264 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 997195776 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-385cdb1f-3b58-4663-a8b2-a53bf25fdcbd req-b867041b-4646-4a5a-90a1-1d15f0bd69a9 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received event network-vif-plugged-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-385cdb1f-3b58-4663-a8b2-a53bf25fdcbd req-b867041b-4646-4a5a-90a1-1d15f0bd69a9 service nova] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-385cdb1f-3b58-4663-a8b2-a53bf25fdcbd req-b867041b-4646-4a5a-90a1-1d15f0bd69a9 service nova] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-385cdb1f-3b58-4663-a8b2-a53bf25fdcbd req-b867041b-4646-4a5a-90a1-1d15f0bd69a9 service nova] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-385cdb1f-3b58-4663-a8b2-a53bf25fdcbd req-b867041b-4646-4a5a-90a1-1d15f0bd69a9 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] No waiting events found dispatching network-vif-plugged-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:22 user nova-compute[72998]: WARNING nova.compute.manager [req-385cdb1f-3b58-4663-a8b2-a53bf25fdcbd req-b867041b-4646-4a5a-90a1-1d15f0bd69a9 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received unexpected event network-vif-plugged-85f6bd9d-2413-407d-9172-9fd50266255a for instance with vm_state building and task_state spawning.
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260242.1304626, cfbd3131-e61b-45a4-8c69-91081320f046 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:17:22 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] VM Resumed (Lifecycle Event)
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:17:22 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Instance spawned successfully.
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVRfmdKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:22 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:17:22 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260242.1321106, cfbd3131-e61b-45a4-8c69-91081320f046 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:17:22 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] VM Started (Lifecycle Event)
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da908d8-5d98-4e3f-836a-769511f92dca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:17:22 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8237d5-9f42-4b66-b0cc-f6087ab9695c]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:22 user nova-compute[72998]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:22 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:22 user nova-compute[72998]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:22 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488574940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:22 user nova-compute[72998]: INFO nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d065540e-725b-44a8-aaa3-0a09f24a560c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd399adf-e0ec-4a06-be8b-38acf8319982]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4044df-92a5-4032-99fc-ed73cafbe9e5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:22 user nova-compute[72998]: INFO nova.compute.manager [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Took 7.54 seconds to build instance.
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f016e5e0-7785-4517-a689-66a18d5339d1]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[412a1f43-c9bb-429a-bcd8-ff8ea3b4b8ed]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a9815be-cef9-4d1b-8f9d-124a85a27b71 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.667s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e151457-2493-4494-856e-fe815e8f8fd1]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260]
Aug 17 08:17:22 user nova-compute[72998]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260] successful.
Aug 17 08:17:22 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a226dea-a7a7-4f1e-b868-ada5e075ec1c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] <== disconnect_volume: return (285ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUTdEbvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c3d1e35d-0cec-451b-b0b8-c51fbfd78c37', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd47e5c2-b4f9-4b89-aa01-b03987dad218', 'serial'} {{(pid=72998) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] swap_volume: removing Cinder connection for volume e4228be6-ba70-4efe-b04d-e86a9d58368a {{(pid=72998) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 08:17:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] swap_volume: Updating volume e4228be6-ba70-4efe-b04d-e86a9d58368a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "VUTdEbvc", "auth_password": "KiVHhzFw2g1Zk0", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "bd47e5c2-b4f9-4b89-aa01-b03987dad218"}, "status": "reserved", "instance": "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37", "attached_at": "", "detached_at": "", "volume_id": "bd47e5c2-b4f9-4b89-aa01-b03987dad218", "serial": "bd47e5c2-b4f9-4b89-aa01-b03987dad218"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bd47e5c2-b4f9-4b89-aa01-b03987dad218', 'no_device': None, 'attachment_id': '56d25024-434c-4941-a7ef-7d636e0ffc8e'} {{(pid=72998) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 08:17:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-af7497da-2e78-4919-b585-d63b386fc9f4 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.156s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG os_brick.utils [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8c0939-379c-415a-9a56-52fe93bd0eb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c836c16a-ed2d-4eaf-9ce7-d11226255bba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db2c213-0b74-47d0-8eda-97249bf0e533]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecc62c1-2241-4467-9c45-c73240bca4ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:17:24 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:17:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f676a2-43c0-42df-83ef-cafff837bf24]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:17:24 user nova-compute[72998]: DEBUG os_brick.utils [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:24 user nova-compute[72998]: INFO nova.compute.manager [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Swapping volume bd47e5c2-b4f9-4b89-aa01-b03987dad218 for e4228be6-ba70-4efe-b04d-e86a9d58368a
Aug 17 08:17:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:17:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:17:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:17:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:17:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:17:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVRfmdKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3d1e35d-0cec-451b-b0b8-c51fbfd78c37', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4228be6-ba70-4efe-b04d-e86a9d58368a', 'serial': 'e4228be6-ba70-4efe-b04d-e86a9d58368a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUTdEbvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'bd47e5c2-b4f9-4b89-aa01-b03987dad218'}, 'status': 'reserved', 'instance': 'c3d1e35d-0cec-451b-b0b8-c51fbfd78c37', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd47e5c2-b4f9-4b89-aa01-b03987dad218', 'serial'} {{(pid=72998) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVRfmdKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:36 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b944a93-794b-4294-9ed3-3fa5da052bd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:17:36 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bada45c9-2fb0-414c-bd18-eeed2bafd624]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a] added
Aug 17 08:17:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[be78bf8e-3f3b-4235-b21e-cb484c7f80c2]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe0745a-5296-44ea-8a36-f34bee75f613]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVRfmdKs {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVRfmdKs" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bc1dc7-d61f-4488-99e0-85d1f0c21dde]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BVRfmdKs'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cae460-3c99-4f96-98b0-bd8e1d6187e8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[863707c6-2cb3-4b7c-9332-c10b62e4d169]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e6bef4-83f0-4c9e-bbdc-1fbca7d9f21e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260]
Aug 17 08:17:36 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260] successful.
Aug 17 08:17:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[021425af-8b9d-46d5-975a-57df6813d375]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afd7cb3-4d1a-4ff1-9dcf-bca9fb67f913]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:36 user nova-compute[72998]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:36 user nova-compute[72998]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecea664-d99f-4af4-975e-4c2e34fe8a0e]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:17:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVRfmdKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:17:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23661333131323766', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661333131323766', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:17:37 user nova-compute[72998]: DEBUG nova.objects.instance [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lazy-loading 'flavor' on Instance uuid c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:38 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:38 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 127926272 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 291504128 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 476053504 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 662700032 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 814743552 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 987758592 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:17:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUTdEbvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'bd47e5c2-b4f9-4b89-aa01-b03987dad218'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:42 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56dfacf-820f-4d66-8037-244d2f691666]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f002a598-faad-45f1-8dc8-5e31e76c65b6]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:42 user nova-compute[72998]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 (non-flash)
Aug 17 08:17:42 user nova-compute[72998]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4885a5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b808d31e-c1b4-4fc3-b5f6-b8e37de2da5a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2546152-d96d-41b0-b310-a89ea30e2ed8]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33314a-f0c3-42d7-8c89-70a81ee7fe97]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[821ea279-b8f0-4d1b-b88c-0b4d6f08b1fa]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de40ea5-5148-469c-8831-84cff6dabd0f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e1767-2f08-4c0e-8aa8-c0c7932d5b99]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218, portal: 172.16.0.220,3260]
Aug 17 08:17:42 user nova-compute[72998]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218, portal: 172.16.0.220,3260] successful.
Aug 17 08:17:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd47e5c2-b4f9-4b89-aa01-b03987dad218 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c739e30-1cb8-4690-ad99-378181cc70b9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] <== disconnect_volume: return (315ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG nova.compute.manager [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVRfmdKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c3d1e35d-0cec-451b-b0b8-c51fbfd78c37', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4228be6-ba70-4efe-b04d-e86a9d58368a', 'serial'} {{(pid=72998) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG nova.compute.manager [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] swap_volume: removing Cinder connection for volume bd47e5c2-b4f9-4b89-aa01-b03987dad218 {{(pid=72998) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 08:17:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] swap_volume: Updating volume bd47e5c2-b4f9-4b89-aa01-b03987dad218 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "BVRfmdKs", "auth_password": "Ma0vOYFl62bgKm", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "e4228be6-ba70-4efe-b04d-e86a9d58368a"}, "status": "reserved", "instance": "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37", "attached_at": "", "detached_at": "", "volume_id": "e4228be6-ba70-4efe-b04d-e86a9d58368a", "serial": "e4228be6-ba70-4efe-b04d-e86a9d58368a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e4228be6-ba70-4efe-b04d-e86a9d58368a', 'no_device': None, 'attachment_id': 'ff5e25b8-f879-43b4-a38a-fb50f3c1a32d'} {{(pid=72998) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 08:17:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-12d80247-fdee-4b01-9d37-d3be890412a1 tempest-TestVolumeSwap-2113938381 tempest-TestVolumeSwap-2113938381-project-admin] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:44 user nova-compute[72998]: INFO nova.compute.manager [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Detaching volume e4228be6-ba70-4efe-b04d-e86a9d58368a
Aug 17 08:17:44 user nova-compute[72998]: INFO nova.virt.block_device [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Attempting to driver detach volume e4228be6-ba70-4efe-b04d-e86a9d58368a from mountpoint /dev/vdb
Aug 17 08:17:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Attempting to detach device vdb from instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:17:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:17:44 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:17:44 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:17:44 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:17:44 user nova-compute[72998]:   <serial>e4228be6-ba70-4efe-b04d-e86a9d58368a</serial>
Aug 17 08:17:44 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:17:44 user nova-compute[72998]: </disk>
Aug 17 08:17:44 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:17:44 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Successfully detached device vdb from instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 from the persistent domain config.
Aug 17 08:17:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:17:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:17:44 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:17:44 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:17:44 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:17:44 user nova-compute[72998]:   <serial>e4228be6-ba70-4efe-b04d-e86a9d58368a</serial>
Aug 17 08:17:44 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:17:44 user nova-compute[72998]: </disk>
Aug 17 08:17:44 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260265.2271554, c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:17:45 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Successfully detached device vdb from instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 from the live domain config.
Aug 17 08:17:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVRfmdKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'e4228be6-ba70-4efe-b04d-e86a9d58368a'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:17:45 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb5acb8-ed79-4503-8374-0260939c2c80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4061adc8-8c51-4f9d-bbd4-587a355472c1]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:45 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a (non-flash)
Aug 17 08:17:45 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4b4f4b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44aba66-87ce-4fda-b5d2-4dcc30b143bc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c0fb9c-351d-4688-aa59-63d9d5be0b20]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b57e4d-569c-4923-a9c6-54994c221bae]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:45 user nova-compute[72998]: INFO nova.compute.manager [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Terminating instance
Aug 17 08:17:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eff7f9-04cf-4846-8191-e614f46872bc]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[71955dba-11f2-4e88-9218-c9af24344d2d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc03035-998f-4649-92df-8288f9d832b7]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260]
Aug 17 08:17:45 user nova-compute[72998]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a, portal: 172.16.0.220,3260] successful.
Aug 17 08:17:45 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4228be6-ba70-4efe-b04d-e86a9d58368a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7bef8b-c9ba-47b4-ad51-6559fbc93f6c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] <== disconnect_volume: return (371ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Instance destroyed successfully.
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lazy-loading 'resources' on Instance uuid e087f5bf-889a-462d-a412-4a39e829f6ec {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:14:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-900252933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-900252933',id=8,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVTnC3gnP971i31Ttky/4Xg/EnkXcozD7zi9pP8iuMWUahf+05KbIMa109iWM3ukXkgnqBJa6j0JfmxF37zj1tzySFuAQ4DGs1cYm513zaFxLSVFwigoX2hV94IwNMXxg==',key_name='tempest-keypair-1262423847',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9985c560f34f4991b6cb938d8b6fcd57',ramdisk_id='',reservation_id='r-3vy0dn1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1304973980',owner_user_name='tempest-TaggedAttachmentsTest-1304973980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14c6925b804342b7bee762e57a0fe9a1',uuid=e087f5bf-889a-462d-a412-4a39e829f6ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converting VIF {"id": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "address": "fa:16:3e:6c:e7:43", "network": {"id": "b0cf5987-3599-4520-845d-4e2b2610068a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-358807205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9985c560f34f4991b6cb938d8b6fcd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ac8bc8-cc", "ovs_interfaceid": "76ac8bc8-ccbc-42fd-8caa-5c01cad6148f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:e7:43,bridge_name='br-int',has_traffic_filtering=True,id=76ac8bc8-ccbc-42fd-8caa-5c01cad6148f,network=Network(b0cf5987-3599-4520-845d-4e2b2610068a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ac8bc8-cc') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG os_vif [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:e7:43,bridge_name='br-int',has_traffic_filtering=True,id=76ac8bc8-ccbc-42fd-8caa-5c01cad6148f,network=Network(b0cf5987-3599-4520-845d-4e2b2610068a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ac8bc8-cc') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76ac8bc8-cc, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:17:46 user nova-compute[72998]: INFO os_vif [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:e7:43,bridge_name='br-int',has_traffic_filtering=True,id=76ac8bc8-ccbc-42fd-8caa-5c01cad6148f,network=Network(b0cf5987-3599-4520-845d-4e2b2610068a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ac8bc8-cc')
Aug 17 08:17:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Deleting instance files /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec_del
Aug 17 08:17:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Deletion of /opt/stack/data/nova/instances/e087f5bf-889a-462d-a412-4a39e829f6ec_del complete
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:46 user nova-compute[72998]: INFO nova.compute.manager [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Terminating instance
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:17:46 user nova-compute[72998]: INFO nova.compute.manager [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.objects.instance [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lazy-loading 'flavor' on Instance uuid c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-a8bb265c-43a0-495d-a021-833b486e01df req-dbcf53bb-35e6-45a6-a551-4055374182ad service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-unplugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a8bb265c-43a0-495d-a021-833b486e01df req-dbcf53bb-35e6-45a6-a551-4055374182ad service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a8bb265c-43a0-495d-a021-833b486e01df req-dbcf53bb-35e6-45a6-a551-4055374182ad service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a8bb265c-43a0-495d-a021-833b486e01df req-dbcf53bb-35e6-45a6-a551-4055374182ad service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-a8bb265c-43a0-495d-a021-833b486e01df req-dbcf53bb-35e6-45a6-a551-4055374182ad service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-unplugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-a8bb265c-43a0-495d-a021-833b486e01df req-dbcf53bb-35e6-45a6-a551-4055374182ad service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-unplugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-21b34c96-9f2b-444a-9977-5d87b0037302 tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.135s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-7a567846-bfd7-4de2-9520-cb01454577f9 req-b6bcfcd9-4a2b-4881-a2f8-69693f29683d service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received event network-vif-unplugged-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7a567846-bfd7-4de2-9520-cb01454577f9 req-b6bcfcd9-4a2b-4881-a2f8-69693f29683d service nova] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7a567846-bfd7-4de2-9520-cb01454577f9 req-b6bcfcd9-4a2b-4881-a2f8-69693f29683d service nova] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7a567846-bfd7-4de2-9520-cb01454577f9 req-b6bcfcd9-4a2b-4881-a2f8-69693f29683d service nova] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-7a567846-bfd7-4de2-9520-cb01454577f9 req-b6bcfcd9-4a2b-4881-a2f8-69693f29683d service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] No waiting events found dispatching network-vif-unplugged-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-7a567846-bfd7-4de2-9520-cb01454577f9 req-b6bcfcd9-4a2b-4881-a2f8-69693f29683d service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received event network-vif-unplugged-adc18de6-340a-44b0-814b-f1c5345805f7 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:17:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Instance destroyed successfully.
Aug 17 08:17:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lazy-loading 'resources' on Instance uuid ffb74821-5eff-4099-8bb6-d35d33ad1b87 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1767592221',display_name='tempest-VolumesAssistedSnapshotsTest-server-1767592221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1767592221',id=5,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL03JcvDTiyZtspb484FKd4yUO9MGouQBcvtg2oJL0koXTGKNyi5Pk/MSPDJTUOFn/l/37KtH3u7mYbMlLGVMtUU+7ZC6QHzq17LatOyZtY5/g0T22hnszzOuPBro5W8sw==',key_name='tempest-keypair-1579729383',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5a18b85c6664687aac505b5b72077b7',ramdisk_id='',reservation_id='r-py3e3qko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1422585177',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1422585177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e09e792e114f4e39a78f5bc4f7c83279',uuid=ffb74821-5eff-4099-8bb6-d35d33ad1b87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Converting VIF {"id": "adc18de6-340a-44b0-814b-f1c5345805f7", "address": "fa:16:3e:1b:d7:33", "network": {"id": "7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1595526732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5a18b85c6664687aac505b5b72077b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc18de6-34", "ovs_interfaceid": "adc18de6-340a-44b0-814b-f1c5345805f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:d7:33,bridge_name='br-int',has_traffic_filtering=True,id=adc18de6-340a-44b0-814b-f1c5345805f7,network=Network(7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc18de6-34') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG os_vif [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:d7:33,bridge_name='br-int',has_traffic_filtering=True,id=adc18de6-340a-44b0-814b-f1c5345805f7,network=Network(7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc18de6-34') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadc18de6-34, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:47 user nova-compute[72998]: INFO os_vif [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:d7:33,bridge_name='br-int',has_traffic_filtering=True,id=adc18de6-340a-44b0-814b-f1c5345805f7,network=Network(7f6d0420-bc40-4e75-8d6f-4a4e3e3ba618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc18de6-34')
Aug 17 08:17:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Deleting instance files /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87_del
Aug 17 08:17:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Deletion of /opt/stack/data/nova/instances/ffb74821-5eff-4099-8bb6-d35d33ad1b87_del complete
Aug 17 08:17:47 user nova-compute[72998]: INFO nova.compute.manager [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 17 08:17:47 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:17:47 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:48 user nova-compute[72998]: WARNING nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f for instance with vm_state active and task_state deleting.
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:48 user nova-compute[72998]: WARNING nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f for instance with vm_state active and task_state deleting.
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:48 user nova-compute[72998]: WARNING nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f for instance with vm_state active and task_state deleting.
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-unplugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-unplugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-unplugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Acquiring lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] No waiting events found dispatching network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:48 user nova-compute[72998]: WARNING nova.compute.manager [req-e7bf36fe-c8df-4786-b7c4-72141c7afafc req-8750ed7a-f54f-4001-b128-aee8e4d84d83 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received unexpected event network-vif-plugged-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f for instance with vm_state active and task_state deleting.
Aug 17 08:17:49 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:17:49 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Took 1.58 seconds to deallocate network for instance.
Aug 17 08:17:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-f531a249-fba3-4bc5-b246-0ab10ba42a15 req-c9cee20a-080b-4c60-aa85-d957af4dbdc5 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received event network-vif-plugged-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f531a249-fba3-4bc5-b246-0ab10ba42a15 req-c9cee20a-080b-4c60-aa85-d957af4dbdc5 service nova] Acquiring lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f531a249-fba3-4bc5-b246-0ab10ba42a15 req-c9cee20a-080b-4c60-aa85-d957af4dbdc5 service nova] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f531a249-fba3-4bc5-b246-0ab10ba42a15 req-c9cee20a-080b-4c60-aa85-d957af4dbdc5 service nova] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-f531a249-fba3-4bc5-b246-0ab10ba42a15 req-c9cee20a-080b-4c60-aa85-d957af4dbdc5 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] No waiting events found dispatching network-vif-plugged-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:49 user nova-compute[72998]: WARNING nova.compute.manager [req-f531a249-fba3-4bc5-b246-0ab10ba42a15 req-c9cee20a-080b-4c60-aa85-d957af4dbdc5 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received unexpected event network-vif-plugged-adc18de6-340a-44b0-814b-f1c5345805f7 for instance with vm_state active and task_state deleting.
Aug 17 08:17:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:17:49 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Took 3.00 seconds to deallocate network for instance.
Aug 17 08:17:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.178s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:49 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Deleted allocations for instance ffb74821-5eff-4099-8bb6-d35d33ad1b87
Aug 17 08:17:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e89a554d-dcc0-422c-998a-3a074265cc61 tempest-VolumesAssistedSnapshotsTest-1422585177 tempest-VolumesAssistedSnapshotsTest-1422585177-project-member] Lock "ffb74821-5eff-4099-8bb6-d35d33ad1b87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.464s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:50 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:17:50 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:17:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:50 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Deleted allocations for instance e087f5bf-889a-462d-a412-4a39e829f6ec
Aug 17 08:17:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d9d0b640-df41-4cce-b9b5-ef38a495d9a1 tempest-TaggedAttachmentsTest-1304973980 tempest-TaggedAttachmentsTest-1304973980-project-member] Lock "e087f5bf-889a-462d-a412-4a39e829f6ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.958s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-2da1ac62-ffab-4134-8ed7-865a5064bf73 req-31d5afca-8624-47fd-8b3f-814b70c28816 service nova] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Received event network-vif-deleted-adc18de6-340a-44b0-814b-f1c5345805f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:17:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-cdabf915-32e5-454d-806d-1d7031715a1e req-0d7eaa54-81b9-4a56-bde5-eab0f7cb6056 service nova] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Received event network-vif-deleted-76ac8bc8-ccbc-42fd-8caa-5c01cad6148f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:17:52 user nova-compute[72998]: INFO nova.compute.claims [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Claim successful on node user
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:17:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:17:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Creating image(s)
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.policy [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c2d6611c58043b49fb9f2ab7ce26288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a5f424a6894c6ca4148962ede48515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:17:52 user nova-compute[72998]: INFO nova.compute.claims [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Claim successful on node user
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.238s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk 1073741824" returned: 0 in 0.067s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.210s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:17:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.policy [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0be579ee85cb4ac2b59812bbee48c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62167eb6909402f8dca89678acff055', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Cannot resize image /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'migration_context' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:17:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Creating image(s)
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Ensure instance console log exists: /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk 1073741824" returned: 0 in 0.056s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Successfully created port: 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Successfully created port: 8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Cannot resize image /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG nova.objects.instance [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'migration_context' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Ensure instance console log exists: /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Successfully updated port: 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquired lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-5ab43b7d-c556-4a78-bd26-848f973c1541 req-b3660029-865d-460c-bdba-86ff1521b6e2 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-changed-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-5ab43b7d-c556-4a78-bd26-848f973c1541 req-b3660029-865d-460c-bdba-86ff1521b6e2 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Refreshing instance network info cache due to event network-changed-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5ab43b7d-c556-4a78-bd26-848f973c1541 req-b3660029-865d-460c-bdba-86ff1521b6e2 service nova] Acquiring lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating instance_info_cache with network_info: [{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Releasing lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Instance network_info: |[{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5ab43b7d-c556-4a78-bd26-848f973c1541 req-b3660029-865d-460c-bdba-86ff1521b6e2 service nova] Acquired lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.neutron [req-5ab43b7d-c556-4a78-bd26-848f973c1541 req-b3660029-865d-460c-bdba-86ff1521b6e2 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Refreshing network info cache for port 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Start _get_guest_xml network_info=[{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:17:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:17:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Successfully updated port: 8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-568118166',display_name='tempest-ServerStableDeviceRescueTest-server-568118166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-568118166',id=12,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFoA5hMyyiQ9viW/O8jFPBLdISk/aDucVxb9hWkjB2hv7CHUVFi3GGx9ludTZ07TvnXYluZDk6yEtsSALMXSKfg4YR4YfCFcRR4EFK//wWhiIg9gQCvwW+r9dNFcEDIdA==',key_name='tempest-keypair-1604276468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a5f424a6894c6ca4148962ede48515',ramdisk_id='',reservation_id='r-kxqkhjat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1264944838',owner_user_name='tempest-ServerStableDeviceRescueTest-1264944838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c2d6611c58043b49fb9f2ab7ce26288',uuid=794e686e-2e6a-42f5-b817-5d18d2ad705e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Converting VIF {"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7f:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f14bfc7-3d2d-4f6f-ad48-80946cac3cef,network=Network(bbdc418d-15ca-46dd-923d-86e61709d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f14bfc7-3d') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'pci_devices' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "refresh_cache-f79a3323-477f-4689-b8e3-35f2ff59a641" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquired lock "refresh_cache-f79a3323-477f-4689-b8e3-35f2ff59a641" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-a148bde2-5728-48a3-8de4-e0bb307ca74d req-eaffef57-cf63-4915-8c7a-a7945def932c service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-changed-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-a148bde2-5728-48a3-8de4-e0bb307ca74d req-eaffef57-cf63-4915-8c7a-a7945def932c service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Refreshing instance network info cache due to event network-changed-8cbeff07-8a68-46c9-92b4-58f4f07fb208. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a148bde2-5728-48a3-8de4-e0bb307ca74d req-eaffef57-cf63-4915-8c7a-a7945def932c service nova] Acquiring lock "refresh_cache-f79a3323-477f-4689-b8e3-35f2ff59a641" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:17:55 user nova-compute[72998]:   <uuid>794e686e-2e6a-42f5-b817-5d18d2ad705e</uuid>
Aug 17 08:17:55 user nova-compute[72998]:   <name>instance-0000000c</name>
Aug 17 08:17:55 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:17:55 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:17:55 user nova-compute[72998]:   <metadata>
Aug 17 08:17:55 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:17:55 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:17:55 user nova-compute[72998]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-568118166</nova:name>
Aug 17 08:17:55 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:17:55</nova:creationTime>
Aug 17 08:17:55 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:17:55 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:17:55 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:17:55 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:17:55 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:17:55 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:17:55 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:17:55 user nova-compute[72998]:       <nova:owner>
Aug 17 08:17:55 user nova-compute[72998]:         <nova:user uuid="0c2d6611c58043b49fb9f2ab7ce26288">tempest-ServerStableDeviceRescueTest-1264944838-project-member</nova:user>
Aug 17 08:17:55 user nova-compute[72998]:         <nova:project uuid="e0a5f424a6894c6ca4148962ede48515">tempest-ServerStableDeviceRescueTest-1264944838</nova:project>
Aug 17 08:17:55 user nova-compute[72998]:       </nova:owner>
Aug 17 08:17:55 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:17:55 user nova-compute[72998]:       <nova:ports>
Aug 17 08:17:55 user nova-compute[72998]:         <nova:port uuid="4f14bfc7-3d2d-4f6f-ad48-80946cac3cef">
Aug 17 08:17:55 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 08:17:55 user nova-compute[72998]:         </nova:port>
Aug 17 08:17:55 user nova-compute[72998]:       </nova:ports>
Aug 17 08:17:55 user nova-compute[72998]:     </nova:instance>
Aug 17 08:17:55 user nova-compute[72998]:   </metadata>
Aug 17 08:17:55 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:17:55 user nova-compute[72998]:     <system>
Aug 17 08:17:55 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:17:55 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:17:55 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:17:55 user nova-compute[72998]:       <entry name="serial">794e686e-2e6a-42f5-b817-5d18d2ad705e</entry>
Aug 17 08:17:55 user nova-compute[72998]:       <entry name="uuid">794e686e-2e6a-42f5-b817-5d18d2ad705e</entry>
Aug 17 08:17:55 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:17:55 user nova-compute[72998]:     </system>
Aug 17 08:17:55 user nova-compute[72998]:   </sysinfo>
Aug 17 08:17:55 user nova-compute[72998]:   <os>
Aug 17 08:17:55 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:17:55 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:17:55 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:17:55 user nova-compute[72998]:   </os>
Aug 17 08:17:55 user nova-compute[72998]:   <features>
Aug 17 08:17:55 user nova-compute[72998]:     <acpi/>
Aug 17 08:17:55 user nova-compute[72998]:     <apic/>
Aug 17 08:17:55 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:17:55 user nova-compute[72998]:   </features>
Aug 17 08:17:55 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:17:55 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:17:55 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:17:55 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:17:55 user nova-compute[72998]:   </clock>
Aug 17 08:17:55 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:17:55 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:17:55 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:17:55 user nova-compute[72998]:   </cpu>
Aug 17 08:17:55 user nova-compute[72998]:   <devices>
Aug 17 08:17:55 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:17:55 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:17:55 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk"/>
Aug 17 08:17:55 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:17:55 user nova-compute[72998]:     </disk>
Aug 17 08:17:55 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:17:55 user nova-compute[72998]:       <mac address="fa:16:3e:b4:7f:f0"/>
Aug 17 08:17:55 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:17:55 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:17:55 user nova-compute[72998]:       <target dev="tap4f14bfc7-3d"/>
Aug 17 08:17:55 user nova-compute[72998]:     </interface>
Aug 17 08:17:55 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:17:55 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/console.log" append="off"/>
Aug 17 08:17:55 user nova-compute[72998]:     </serial>
Aug 17 08:17:55 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:17:55 user nova-compute[72998]:     <video>
Aug 17 08:17:55 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:17:55 user nova-compute[72998]:     </video>
Aug 17 08:17:55 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:17:55 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:17:55 user nova-compute[72998]:     </rng>
Aug 17 08:17:55 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:17:55 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:17:55 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:17:55 user nova-compute[72998]:     </memballoon>
Aug 17 08:17:55 user nova-compute[72998]:   </devices>
Aug 17 08:17:55 user nova-compute[72998]: </domain>
Aug 17 08:17:55 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-568118166',display_name='tempest-ServerStableDeviceRescueTest-server-568118166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-568118166',id=12,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFoA5hMyyiQ9viW/O8jFPBLdISk/aDucVxb9hWkjB2hv7CHUVFi3GGx9ludTZ07TvnXYluZDk6yEtsSALMXSKfg4YR4YfCFcRR4EFK//wWhiIg9gQCvwW+r9dNFcEDIdA==',key_name='tempest-keypair-1604276468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a5f424a6894c6ca4148962ede48515',ramdisk_id='',reservation_id='r-kxqkhjat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1264944838',owner_user_name='tempest-ServerStableDeviceRescueTest-1264944838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c2d6611c58043b49fb9f2ab7ce26288',uuid=794e686e-2e6a-42f5-b817-5d18d2ad705e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Converting VIF {"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7f:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f14bfc7-3d2d-4f6f-ad48-80946cac3cef,network=Network(bbdc418d-15ca-46dd-923d-86e61709d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f14bfc7-3d') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG os_vif [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7f:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f14bfc7-3d2d-4f6f-ad48-80946cac3cef,network=Network(bbdc418d-15ca-46dd-923d-86e61709d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f14bfc7-3d') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f14bfc7-3d, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f14bfc7-3d, col_values=(('external_ids', {'iface-id': '4f14bfc7-3d2d-4f6f-ad48-80946cac3cef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:7f:f0', 'vm-uuid': '794e686e-2e6a-42f5-b817-5d18d2ad705e'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:17:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:55 user nova-compute[72998]: INFO os_vif [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7f:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f14bfc7-3d2d-4f6f-ad48-80946cac3cef,network=Network(bbdc418d-15ca-46dd-923d-86e61709d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f14bfc7-3d')
Aug 17 08:17:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] No VIF found with MAC fa:16:3e:b4:7f:f0, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-5ab43b7d-c556-4a78-bd26-848f973c1541 req-b3660029-865d-460c-bdba-86ff1521b6e2 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updated VIF entry in instance network info cache for port 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-5ab43b7d-c556-4a78-bd26-848f973c1541 req-b3660029-865d-460c-bdba-86ff1521b6e2 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating instance_info_cache with network_info: [{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.neutron [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Updating instance_info_cache with network_info: [{"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5ab43b7d-c556-4a78-bd26-848f973c1541 req-b3660029-865d-460c-bdba-86ff1521b6e2 service nova] Releasing lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Releasing lock "refresh_cache-f79a3323-477f-4689-b8e3-35f2ff59a641" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Instance network_info: |[{"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a148bde2-5728-48a3-8de4-e0bb307ca74d req-eaffef57-cf63-4915-8c7a-a7945def932c service nova] Acquired lock "refresh_cache-f79a3323-477f-4689-b8e3-35f2ff59a641" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-a148bde2-5728-48a3-8de4-e0bb307ca74d req-eaffef57-cf63-4915-8c7a-a7945def932c service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Refreshing network info cache for port 8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Start _get_guest_xml network_info=[{"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:17:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:17:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-649770025',display_name='tempest-tempest.common.compute-instance-649770025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-649770025',id=13,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkgz6KIvkjo7YISoQuK0gKb5worGqa3M96YDdoFGvE2t+BrFcgavSDbwPCbWbcUEBpB4d8lGQtJpxdLC26DtEQzWbxv/vhiZjqnt3G/kF8kNKY2c+leCXryY3xsQnrvtA==',key_name='tempest-keypair-1697256322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-lz1l9ivg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=f79a3323-477f-4689-b8e3-35f2ff59a641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'pci_devices' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:17:56 user nova-compute[72998]:   <uuid>f79a3323-477f-4689-b8e3-35f2ff59a641</uuid>
Aug 17 08:17:56 user nova-compute[72998]:   <name>instance-0000000d</name>
Aug 17 08:17:56 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:17:56 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:17:56 user nova-compute[72998]:   <metadata>
Aug 17 08:17:56 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:17:56 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:17:56 user nova-compute[72998]:       <nova:name>tempest-tempest.common.compute-instance-649770025</nova:name>
Aug 17 08:17:56 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:17:56</nova:creationTime>
Aug 17 08:17:56 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:17:56 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:17:56 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:17:56 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:17:56 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:17:56 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:17:56 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:17:56 user nova-compute[72998]:       <nova:owner>
Aug 17 08:17:56 user nova-compute[72998]:         <nova:user uuid="0be579ee85cb4ac2b59812bbee48c272">tempest-ServerActionsTestOtherA-1892042619-project-member</nova:user>
Aug 17 08:17:56 user nova-compute[72998]:         <nova:project uuid="d62167eb6909402f8dca89678acff055">tempest-ServerActionsTestOtherA-1892042619</nova:project>
Aug 17 08:17:56 user nova-compute[72998]:       </nova:owner>
Aug 17 08:17:56 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:17:56 user nova-compute[72998]:       <nova:ports>
Aug 17 08:17:56 user nova-compute[72998]:         <nova:port uuid="8cbeff07-8a68-46c9-92b4-58f4f07fb208">
Aug 17 08:17:56 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:17:56 user nova-compute[72998]:         </nova:port>
Aug 17 08:17:56 user nova-compute[72998]:       </nova:ports>
Aug 17 08:17:56 user nova-compute[72998]:     </nova:instance>
Aug 17 08:17:56 user nova-compute[72998]:   </metadata>
Aug 17 08:17:56 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:17:56 user nova-compute[72998]:     <system>
Aug 17 08:17:56 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:17:56 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:17:56 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:17:56 user nova-compute[72998]:       <entry name="serial">f79a3323-477f-4689-b8e3-35f2ff59a641</entry>
Aug 17 08:17:56 user nova-compute[72998]:       <entry name="uuid">f79a3323-477f-4689-b8e3-35f2ff59a641</entry>
Aug 17 08:17:56 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:17:56 user nova-compute[72998]:     </system>
Aug 17 08:17:56 user nova-compute[72998]:   </sysinfo>
Aug 17 08:17:56 user nova-compute[72998]:   <os>
Aug 17 08:17:56 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:17:56 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:17:56 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:17:56 user nova-compute[72998]:   </os>
Aug 17 08:17:56 user nova-compute[72998]:   <features>
Aug 17 08:17:56 user nova-compute[72998]:     <acpi/>
Aug 17 08:17:56 user nova-compute[72998]:     <apic/>
Aug 17 08:17:56 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:17:56 user nova-compute[72998]:   </features>
Aug 17 08:17:56 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:17:56 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:17:56 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:17:56 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:17:56 user nova-compute[72998]:   </clock>
Aug 17 08:17:56 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:17:56 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:17:56 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:17:56 user nova-compute[72998]:   </cpu>
Aug 17 08:17:56 user nova-compute[72998]:   <devices>
Aug 17 08:17:56 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:17:56 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:17:56 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk"/>
Aug 17 08:17:56 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:17:56 user nova-compute[72998]:     </disk>
Aug 17 08:17:56 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:17:56 user nova-compute[72998]:       <mac address="fa:16:3e:aa:80:db"/>
Aug 17 08:17:56 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:17:56 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:17:56 user nova-compute[72998]:       <target dev="tap8cbeff07-8a"/>
Aug 17 08:17:56 user nova-compute[72998]:     </interface>
Aug 17 08:17:56 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:17:56 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/console.log" append="off"/>
Aug 17 08:17:56 user nova-compute[72998]:     </serial>
Aug 17 08:17:56 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:17:56 user nova-compute[72998]:     <video>
Aug 17 08:17:56 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:17:56 user nova-compute[72998]:     </video>
Aug 17 08:17:56 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:17:56 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:17:56 user nova-compute[72998]:     </rng>
Aug 17 08:17:56 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:17:56 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:17:56 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:17:56 user nova-compute[72998]:     </memballoon>
Aug 17 08:17:56 user nova-compute[72998]:   </devices>
Aug 17 08:17:56 user nova-compute[72998]: </domain>
Aug 17 08:17:56 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-649770025',display_name='tempest-tempest.common.compute-instance-649770025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-649770025',id=13,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkgz6KIvkjo7YISoQuK0gKb5worGqa3M96YDdoFGvE2t+BrFcgavSDbwPCbWbcUEBpB4d8lGQtJpxdLC26DtEQzWbxv/vhiZjqnt3G/kF8kNKY2c+leCXryY3xsQnrvtA==',key_name='tempest-keypair-1697256322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-lz1l9ivg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=f79a3323-477f-4689-b8e3-35f2ff59a641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG os_vif [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cbeff07-8a, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8cbeff07-8a, col_values=(('external_ids', {'iface-id': '8cbeff07-8a68-46c9-92b4-58f4f07fb208', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:80:db', 'vm-uuid': 'f79a3323-477f-4689-b8e3-35f2ff59a641'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:56 user nova-compute[72998]: INFO os_vif [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a')
Aug 17 08:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No VIF found with MAC fa:16:3e:aa:80:db, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-a148bde2-5728-48a3-8de4-e0bb307ca74d req-eaffef57-cf63-4915-8c7a-a7945def932c service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Updated VIF entry in instance network info cache for port 8cbeff07-8a68-46c9-92b4-58f4f07fb208. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-a148bde2-5728-48a3-8de4-e0bb307ca74d req-eaffef57-cf63-4915-8c7a-a7945def932c service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Updating instance_info_cache with network_info: [{"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:17:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a148bde2-5728-48a3-8de4-e0bb307ca74d req-eaffef57-cf63-4915-8c7a-a7945def932c service nova] Releasing lock "refresh_cache-f79a3323-477f-4689-b8e3-35f2ff59a641" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:17:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a4df139-81b4-44af-998a-f90339c3354c req-b31f37b8-3638-48a1-bd69-fea1316a7341 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a4df139-81b4-44af-998a-f90339c3354c req-b31f37b8-3638-48a1-bd69-fea1316a7341 service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a4df139-81b4-44af-998a-f90339c3354c req-b31f37b8-3638-48a1-bd69-fea1316a7341 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a4df139-81b4-44af-998a-f90339c3354c req-b31f37b8-3638-48a1-bd69-fea1316a7341 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a4df139-81b4-44af-998a-f90339c3354c req-b31f37b8-3638-48a1-bd69-fea1316a7341 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:57 user nova-compute[72998]: WARNING nova.compute.manager [req-5a4df139-81b4-44af-998a-f90339c3354c req-b31f37b8-3638-48a1-bd69-fea1316a7341 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state building and task_state spawning.
Aug 17 08:17:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-756ef2fd-7891-4f0e-baae-a1fb989a3713 req-0b9b741b-bef6-4113-b3e7-da2ab1d4166e service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-756ef2fd-7891-4f0e-baae-a1fb989a3713 req-0b9b741b-bef6-4113-b3e7-da2ab1d4166e service nova] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-756ef2fd-7891-4f0e-baae-a1fb989a3713 req-0b9b741b-bef6-4113-b3e7-da2ab1d4166e service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-756ef2fd-7891-4f0e-baae-a1fb989a3713 req-0b9b741b-bef6-4113-b3e7-da2ab1d4166e service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-756ef2fd-7891-4f0e-baae-a1fb989a3713 req-0b9b741b-bef6-4113-b3e7-da2ab1d4166e service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] No waiting events found dispatching network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:17:59 user nova-compute[72998]: WARNING nova.compute.manager [req-756ef2fd-7891-4f0e-baae-a1fb989a3713 req-0b9b741b-bef6-4113-b3e7-da2ab1d4166e service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received unexpected event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 for instance with vm_state building and task_state spawning.
Aug 17 08:17:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:17:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-4e5356f0-bc39-46b1-9efa-5160afc76074 req-e1c0d498-0bb8-48fc-a527-e9e7bd7cdde9 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4e5356f0-bc39-46b1-9efa-5160afc76074 req-e1c0d498-0bb8-48fc-a527-e9e7bd7cdde9 service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4e5356f0-bc39-46b1-9efa-5160afc76074 req-e1c0d498-0bb8-48fc-a527-e9e7bd7cdde9 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4e5356f0-bc39-46b1-9efa-5160afc76074 req-e1c0d498-0bb8-48fc-a527-e9e7bd7cdde9 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-4e5356f0-bc39-46b1-9efa-5160afc76074 req-e1c0d498-0bb8-48fc-a527-e9e7bd7cdde9 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:00 user nova-compute[72998]: WARNING nova.compute.manager [req-4e5356f0-bc39-46b1-9efa-5160afc76074 req-e1c0d498-0bb8-48fc-a527-e9e7bd7cdde9 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state building and task_state spawning.
Aug 17 08:18:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Updating instance_info_cache with network_info: [{"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:00 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260281.2492037, 794e686e-2e6a-42f5-b817-5d18d2ad705e => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] VM Resumed (Lifecycle Event)
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260266.255333, e087f5bf-889a-462d-a412-4a39e829f6ec => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] VM Stopped (Lifecycle Event)
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Instance spawned successfully.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Instance spawned successfully.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-700032bd-b4bd-459c-83a6-5702ad1f27ab None None] [instance: e087f5bf-889a-462d-a412-4a39e829f6ec] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260281.2501054, 794e686e-2e6a-42f5-b817-5d18d2ad705e => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] VM Started (Lifecycle Event)
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260281.2709455, f79a3323-477f-4689-b8e3-35f2ff59a641 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] VM Resumed (Lifecycle Event)
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Took 7.84 seconds to spawn the instance on the hypervisor.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260281.2710624, f79a3323-477f-4689-b8e3-35f2ff59a641 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] VM Started (Lifecycle Event)
Aug 17 08:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Took 8.98 seconds to spawn the instance on the hypervisor.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Took 8.87 seconds to build instance.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [req-6ae030ba-437f-4568-b106-e4c992d64ab2 req-e486472b-f4d5-48a5-9f1a-297841880019 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ae030ba-437f-4568-b106-e4c992d64ab2 req-e486472b-f4d5-48a5-9f1a-297841880019 service nova] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ae030ba-437f-4568-b106-e4c992d64ab2 req-e486472b-f4d5-48a5-9f1a-297841880019 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ae030ba-437f-4568-b106-e4c992d64ab2 req-e486472b-f4d5-48a5-9f1a-297841880019 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG nova.compute.manager [req-6ae030ba-437f-4568-b106-e4c992d64ab2 req-e486472b-f4d5-48a5-9f1a-297841880019 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] No waiting events found dispatching network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:01 user nova-compute[72998]: WARNING nova.compute.manager [req-6ae030ba-437f-4568-b106-e4c992d64ab2 req-e486472b-f4d5-48a5-9f1a-297841880019 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received unexpected event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 for instance with vm_state active and task_state None.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-97ac004e-557f-4414-b325-8b7cb716f4e5 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.010s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:01 user nova-compute[72998]: INFO nova.compute.manager [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Took 9.88 seconds to build instance.
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-180fb63f-2f1e-457e-8b5f-a6deb5bea157 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.676s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:02 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260267.361203, ffb74821-5eff-4099-8bb6-d35d33ad1b87 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:02 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] VM Stopped (Lifecycle Event)
Aug 17 08:18:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6e9d78ab-9d48-42fc-b4cc-534b6f421ab8 None None] [instance: ffb74821-5eff-4099-8bb6-d35d33ad1b87] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:18:03 user nova-compute[72998]: INFO nova.compute.claims [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Claim successful on node user
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:04 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:18:04 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Creating image(s)
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "/opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "/opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.011s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "/opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG nova.policy [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e444ed21ebed454cb5c30943a5725f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b23b971dd054295802333297815ee12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.199s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk 1073741824" returned: 0 in 0.052s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.248s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:05 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Successfully created port: 60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json" returned: 0 in 0.600s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Cannot resize image /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lazy-loading 'migration_context' on Instance uuid 70d270c8-e0fc-4b40-a2c9-95dd23316853 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:06 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:18:06 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=24.60053253173828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Ensure instance console log exists: /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cfbd3131-e61b-45a4-8c69-91081320f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 794e686e-2e6a-42f5-b817-5d18d2ad705e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance f79a3323-477f-4689-b8e3-35f2ff59a641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 70d270c8-e0fc-4b40-a2c9-95dd23316853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Successfully updated port: 60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "refresh_cache-70d270c8-e0fc-4b40-a2c9-95dd23316853" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquired lock "refresh_cache-70d270c8-e0fc-4b40-a2c9-95dd23316853" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-7947f15a-d904-4ebb-acda-423a0267a520 req-43f02cd4-be5c-4b16-af20-dcb74f68d344 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-changed-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-7947f15a-d904-4ebb-acda-423a0267a520 req-43f02cd4-be5c-4b16-af20-dcb74f68d344 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Refreshing instance network info cache due to event network-changed-60922f27-88e7-4168-8ffe-efdf5d7d0918. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7947f15a-d904-4ebb-acda-423a0267a520 req-43f02cd4-be5c-4b16-af20-dcb74f68d344 service nova] Acquiring lock "refresh_cache-70d270c8-e0fc-4b40-a2c9-95dd23316853" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:18:06 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Updating instance_info_cache with network_info: [{"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Releasing lock "refresh_cache-70d270c8-e0fc-4b40-a2c9-95dd23316853" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Instance network_info: |[{"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7947f15a-d904-4ebb-acda-423a0267a520 req-43f02cd4-be5c-4b16-af20-dcb74f68d344 service nova] Acquired lock "refresh_cache-70d270c8-e0fc-4b40-a2c9-95dd23316853" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.network.neutron [req-7947f15a-d904-4ebb-acda-423a0267a520 req-43f02cd4-be5c-4b16-af20-dcb74f68d344 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Refreshing network info cache for port 60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Start _get_guest_xml network_info=[{"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:18:07 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:18:07 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1446432849',display_name='tempest-VolumesAdminNegativeTest-server-1446432849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1446432849',id=14,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b23b971dd054295802333297815ee12',ramdisk_id='',reservation_id='r-1vs60rzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1447835405',owner_user_name='tempest-VolumesAdminNegativeTest-1447835405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:18:05Z,user_data=None,user_id='e444ed21ebed454cb5c30943a5725f6b',uuid=70d270c8-e0fc-4b40-a2c9-95dd23316853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converting VIF {"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:09:79,bridge_name='br-int',has_traffic_filtering=True,id=60922f27-88e7-4168-8ffe-efdf5d7d0918,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60922f27-88') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lazy-loading 'pci_devices' on Instance uuid 70d270c8-e0fc-4b40-a2c9-95dd23316853 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:18:07 user nova-compute[72998]:   <uuid>70d270c8-e0fc-4b40-a2c9-95dd23316853</uuid>
Aug 17 08:18:07 user nova-compute[72998]:   <name>instance-0000000e</name>
Aug 17 08:18:07 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:18:07 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:18:07 user nova-compute[72998]:   <metadata>
Aug 17 08:18:07 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:18:07 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:18:07 user nova-compute[72998]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1446432849</nova:name>
Aug 17 08:18:07 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:18:07</nova:creationTime>
Aug 17 08:18:07 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:18:07 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:18:07 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:18:07 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:18:07 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:18:07 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:18:07 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:18:07 user nova-compute[72998]:       <nova:owner>
Aug 17 08:18:07 user nova-compute[72998]:         <nova:user uuid="e444ed21ebed454cb5c30943a5725f6b">tempest-VolumesAdminNegativeTest-1447835405-project-member</nova:user>
Aug 17 08:18:07 user nova-compute[72998]:         <nova:project uuid="0b23b971dd054295802333297815ee12">tempest-VolumesAdminNegativeTest-1447835405</nova:project>
Aug 17 08:18:07 user nova-compute[72998]:       </nova:owner>
Aug 17 08:18:07 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:18:07 user nova-compute[72998]:       <nova:ports>
Aug 17 08:18:07 user nova-compute[72998]:         <nova:port uuid="60922f27-88e7-4168-8ffe-efdf5d7d0918">
Aug 17 08:18:07 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:18:07 user nova-compute[72998]:         </nova:port>
Aug 17 08:18:07 user nova-compute[72998]:       </nova:ports>
Aug 17 08:18:07 user nova-compute[72998]:     </nova:instance>
Aug 17 08:18:07 user nova-compute[72998]:   </metadata>
Aug 17 08:18:07 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:18:07 user nova-compute[72998]:     <system>
Aug 17 08:18:07 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:18:07 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:18:07 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:18:07 user nova-compute[72998]:       <entry name="serial">70d270c8-e0fc-4b40-a2c9-95dd23316853</entry>
Aug 17 08:18:07 user nova-compute[72998]:       <entry name="uuid">70d270c8-e0fc-4b40-a2c9-95dd23316853</entry>
Aug 17 08:18:07 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:18:07 user nova-compute[72998]:     </system>
Aug 17 08:18:07 user nova-compute[72998]:   </sysinfo>
Aug 17 08:18:07 user nova-compute[72998]:   <os>
Aug 17 08:18:07 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:18:07 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:18:07 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:18:07 user nova-compute[72998]:   </os>
Aug 17 08:18:07 user nova-compute[72998]:   <features>
Aug 17 08:18:07 user nova-compute[72998]:     <acpi/>
Aug 17 08:18:07 user nova-compute[72998]:     <apic/>
Aug 17 08:18:07 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:18:07 user nova-compute[72998]:   </features>
Aug 17 08:18:07 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:18:07 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:18:07 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:18:07 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:18:07 user nova-compute[72998]:   </clock>
Aug 17 08:18:07 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:18:07 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:18:07 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:18:07 user nova-compute[72998]:   </cpu>
Aug 17 08:18:07 user nova-compute[72998]:   <devices>
Aug 17 08:18:07 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:18:07 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:18:07 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk"/>
Aug 17 08:18:07 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:18:07 user nova-compute[72998]:     </disk>
Aug 17 08:18:07 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:18:07 user nova-compute[72998]:       <mac address="fa:16:3e:c4:09:79"/>
Aug 17 08:18:07 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:18:07 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:18:07 user nova-compute[72998]:       <target dev="tap60922f27-88"/>
Aug 17 08:18:07 user nova-compute[72998]:     </interface>
Aug 17 08:18:07 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:18:07 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/console.log" append="off"/>
Aug 17 08:18:07 user nova-compute[72998]:     </serial>
Aug 17 08:18:07 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:18:07 user nova-compute[72998]:     <video>
Aug 17 08:18:07 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:18:07 user nova-compute[72998]:     </video>
Aug 17 08:18:07 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:18:07 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:18:07 user nova-compute[72998]:     </rng>
Aug 17 08:18:07 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:18:07 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:18:07 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:18:07 user nova-compute[72998]:     </memballoon>
Aug 17 08:18:07 user nova-compute[72998]:   </devices>
Aug 17 08:18:07 user nova-compute[72998]: </domain>
Aug 17 08:18:07 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1446432849',display_name='tempest-VolumesAdminNegativeTest-server-1446432849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1446432849',id=14,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b23b971dd054295802333297815ee12',ramdisk_id='',reservation_id='r-1vs60rzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1447835405',owner_user_name='tempest-VolumesAdminNegativeTest-1447835405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:18:05Z,user_data=None,user_id='e444ed21ebed454cb5c30943a5725f6b',uuid=70d270c8-e0fc-4b40-a2c9-95dd23316853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converting VIF {"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:09:79,bridge_name='br-int',has_traffic_filtering=True,id=60922f27-88e7-4168-8ffe-efdf5d7d0918,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60922f27-88') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG os_vif [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:09:79,bridge_name='br-int',has_traffic_filtering=True,id=60922f27-88e7-4168-8ffe-efdf5d7d0918,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60922f27-88') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60922f27-88, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60922f27-88, col_values=(('external_ids', {'iface-id': '60922f27-88e7-4168-8ffe-efdf5d7d0918', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:09:79', 'vm-uuid': '70d270c8-e0fc-4b40-a2c9-95dd23316853'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:07 user nova-compute[72998]: INFO os_vif [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:09:79,bridge_name='br-int',has_traffic_filtering=True,id=60922f27-88e7-4168-8ffe-efdf5d7d0918,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60922f27-88')
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] No VIF found with MAC fa:16:3e:c4:09:79, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.network.neutron [req-7947f15a-d904-4ebb-acda-423a0267a520 req-43f02cd4-be5c-4b16-af20-dcb74f68d344 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Updated VIF entry in instance network info cache for port 60922f27-88e7-4168-8ffe-efdf5d7d0918. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG nova.network.neutron [req-7947f15a-d904-4ebb-acda-423a0267a520 req-43f02cd4-be5c-4b16-af20-dcb74f68d344 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Updating instance_info_cache with network_info: [{"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:18:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7947f15a-d904-4ebb-acda-423a0267a520 req-43f02cd4-be5c-4b16-af20-dcb74f68d344 service nova] Releasing lock "refresh_cache-70d270c8-e0fc-4b40-a2c9-95dd23316853" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:18:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-457120ae-6ba1-459f-af5d-ef485d39e5dc req-e23e85bf-4884-4775-a9d0-47889ca45c85 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-457120ae-6ba1-459f-af5d-ef485d39e5dc req-e23e85bf-4884-4775-a9d0-47889ca45c85 service nova] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-457120ae-6ba1-459f-af5d-ef485d39e5dc req-e23e85bf-4884-4775-a9d0-47889ca45c85 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-457120ae-6ba1-459f-af5d-ef485d39e5dc req-e23e85bf-4884-4775-a9d0-47889ca45c85 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-457120ae-6ba1-459f-af5d-ef485d39e5dc req-e23e85bf-4884-4775-a9d0-47889ca45c85 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] No waiting events found dispatching network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:09 user nova-compute[72998]: WARNING nova.compute.manager [req-457120ae-6ba1-459f-af5d-ef485d39e5dc req-e23e85bf-4884-4775-a9d0-47889ca45c85 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received unexpected event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 for instance with vm_state building and task_state spawning.
Aug 17 08:18:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260291.598137, 70d270c8-e0fc-4b40-a2c9-95dd23316853 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:11 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] VM Resumed (Lifecycle Event)
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-117b2ad1-9f24-4569-8817-13c9b58c0553 req-a8ed960a-6757-4c91-8b48-d69a7801093e service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-117b2ad1-9f24-4569-8817-13c9b58c0553 req-a8ed960a-6757-4c91-8b48-d69a7801093e service nova] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-117b2ad1-9f24-4569-8817-13c9b58c0553 req-a8ed960a-6757-4c91-8b48-d69a7801093e service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-117b2ad1-9f24-4569-8817-13c9b58c0553 req-a8ed960a-6757-4c91-8b48-d69a7801093e service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-117b2ad1-9f24-4569-8817-13c9b58c0553 req-a8ed960a-6757-4c91-8b48-d69a7801093e service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] No waiting events found dispatching network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:11 user nova-compute[72998]: WARNING nova.compute.manager [req-117b2ad1-9f24-4569-8817-13c9b58c0553 req-a8ed960a-6757-4c91-8b48-d69a7801093e service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received unexpected event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 for instance with vm_state building and task_state spawning.
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:18:11 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Instance spawned successfully.
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:18:11 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260291.6089416, 70d270c8-e0fc-4b40-a2c9-95dd23316853 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:11 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] VM Started (Lifecycle Event)
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:11 user nova-compute[72998]: INFO nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Took 7.03 seconds to spawn the instance on the hypervisor.
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:18:11 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:18:11 user nova-compute[72998]: INFO nova.compute.manager [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Took 8.22 seconds to build instance.
Aug 17 08:18:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4573a244-3ece-4b36-996f-11174abf50be tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.328s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:18:13 user nova-compute[72998]: INFO nova.compute.claims [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Claim successful on node user
Aug 17 08:18:13 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:18:13 user nova-compute[72998]: DEBUG nova.network.neutron [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:18:13 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:18:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG nova.policy [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf8febbec4ce4eb9a0132c51fae76de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846580b37b3545319d1897e07c828c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:18:14 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Creating image(s)
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.223s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk 1073741824" returned: 0 in 0.058s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.219s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:14 user nova-compute[72998]: DEBUG nova.network.neutron [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Successfully created port: 1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:18:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:15 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Cannot resize image /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:18:15 user nova-compute[72998]: DEBUG nova.objects.instance [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'migration_context' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:18:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Ensure instance console log exists: /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:18:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.network.neutron [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Successfully updated port: 1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquired lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.network.neutron [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-beac4bb2-b808-4039-b60e-6304396aab20 req-930cbe4f-6a4a-416f-901d-8da8b0d3264a service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-changed-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-beac4bb2-b808-4039-b60e-6304396aab20 req-930cbe4f-6a4a-416f-901d-8da8b0d3264a service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Refreshing instance network info cache due to event network-changed-1177fb3c-1f8f-489c-ada6-748478daa64b. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-beac4bb2-b808-4039-b60e-6304396aab20 req-930cbe4f-6a4a-416f-901d-8da8b0d3264a service nova] Acquiring lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.network.neutron [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.network.neutron [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating instance_info_cache with network_info: [{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Releasing lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance network_info: |[{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-beac4bb2-b808-4039-b60e-6304396aab20 req-930cbe4f-6a4a-416f-901d-8da8b0d3264a service nova] Acquired lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.network.neutron [req-beac4bb2-b808-4039-b60e-6304396aab20 req-930cbe4f-6a4a-416f-901d-8da8b0d3264a service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Refreshing network info cache for port 1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Start _get_guest_xml network_info=[{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:18:16 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:18:16 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1227355977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1227355977',id=15,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Ao/Go/8XDt42KXZYAz7AA6xYP7QW9nvLmuMDh5kL5LttNu902QcyLN6d7iY1AKVZtdM+xSQn+inyBY6PhC2wTcUIs19u3C4QCCleb9u11G3dMj8vS2CmA4ZNcVsXapw==',key_name='tempest-keypair-198637846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-9031z9p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.objects.instance [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:18:16 user nova-compute[72998]:   <uuid>9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66</uuid>
Aug 17 08:18:16 user nova-compute[72998]:   <name>instance-0000000f</name>
Aug 17 08:18:16 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:18:16 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:18:16 user nova-compute[72998]:   <metadata>
Aug 17 08:18:16 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:18:16 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:18:16 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1227355977</nova:name>
Aug 17 08:18:16 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:18:16</nova:creationTime>
Aug 17 08:18:16 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:18:16 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:18:16 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:18:16 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:18:16 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:18:16 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:18:16 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:18:16 user nova-compute[72998]:       <nova:owner>
Aug 17 08:18:16 user nova-compute[72998]:         <nova:user uuid="cf8febbec4ce4eb9a0132c51fae76de1">tempest-AttachVolumeShelveTestJSON-257833239-project-member</nova:user>
Aug 17 08:18:16 user nova-compute[72998]:         <nova:project uuid="846580b37b3545319d1897e07c828c59">tempest-AttachVolumeShelveTestJSON-257833239</nova:project>
Aug 17 08:18:16 user nova-compute[72998]:       </nova:owner>
Aug 17 08:18:16 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:18:16 user nova-compute[72998]:       <nova:ports>
Aug 17 08:18:16 user nova-compute[72998]:         <nova:port uuid="1177fb3c-1f8f-489c-ada6-748478daa64b">
Aug 17 08:18:16 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 08:18:16 user nova-compute[72998]:         </nova:port>
Aug 17 08:18:16 user nova-compute[72998]:       </nova:ports>
Aug 17 08:18:16 user nova-compute[72998]:     </nova:instance>
Aug 17 08:18:16 user nova-compute[72998]:   </metadata>
Aug 17 08:18:16 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:18:16 user nova-compute[72998]:     <system>
Aug 17 08:18:16 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:18:16 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:18:16 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:18:16 user nova-compute[72998]:       <entry name="serial">9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66</entry>
Aug 17 08:18:16 user nova-compute[72998]:       <entry name="uuid">9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66</entry>
Aug 17 08:18:16 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:18:16 user nova-compute[72998]:     </system>
Aug 17 08:18:16 user nova-compute[72998]:   </sysinfo>
Aug 17 08:18:16 user nova-compute[72998]:   <os>
Aug 17 08:18:16 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:18:16 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:18:16 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:18:16 user nova-compute[72998]:   </os>
Aug 17 08:18:16 user nova-compute[72998]:   <features>
Aug 17 08:18:16 user nova-compute[72998]:     <acpi/>
Aug 17 08:18:16 user nova-compute[72998]:     <apic/>
Aug 17 08:18:16 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:18:16 user nova-compute[72998]:   </features>
Aug 17 08:18:16 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:18:16 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:18:16 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:18:16 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:18:16 user nova-compute[72998]:   </clock>
Aug 17 08:18:16 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:18:16 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:18:16 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:18:16 user nova-compute[72998]:   </cpu>
Aug 17 08:18:16 user nova-compute[72998]:   <devices>
Aug 17 08:18:16 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:18:16 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:18:16 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk"/>
Aug 17 08:18:16 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:18:16 user nova-compute[72998]:     </disk>
Aug 17 08:18:16 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:18:16 user nova-compute[72998]:       <mac address="fa:16:3e:a4:6c:80"/>
Aug 17 08:18:16 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:18:16 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:18:16 user nova-compute[72998]:       <target dev="tap1177fb3c-1f"/>
Aug 17 08:18:16 user nova-compute[72998]:     </interface>
Aug 17 08:18:16 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:18:16 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/console.log" append="off"/>
Aug 17 08:18:16 user nova-compute[72998]:     </serial>
Aug 17 08:18:16 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:18:16 user nova-compute[72998]:     <video>
Aug 17 08:18:16 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:18:16 user nova-compute[72998]:     </video>
Aug 17 08:18:16 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:18:16 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:18:16 user nova-compute[72998]:     </rng>
Aug 17 08:18:16 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:18:16 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:18:16 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:18:16 user nova-compute[72998]:     </memballoon>
Aug 17 08:18:16 user nova-compute[72998]:   </devices>
Aug 17 08:18:16 user nova-compute[72998]: </domain>
Aug 17 08:18:16 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1227355977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1227355977',id=15,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Ao/Go/8XDt42KXZYAz7AA6xYP7QW9nvLmuMDh5kL5LttNu902QcyLN6d7iY1AKVZtdM+xSQn+inyBY6PhC2wTcUIs19u3C4QCCleb9u11G3dMj8vS2CmA4ZNcVsXapw==',key_name='tempest-keypair-198637846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-9031z9p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG os_vif [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1177fb3c-1f, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1177fb3c-1f, col_values=(('external_ids', {'iface-id': '1177fb3c-1f8f-489c-ada6-748478daa64b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:6c:80', 'vm-uuid': '9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:16 user nova-compute[72998]: INFO os_vif [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f')
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:18:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] No VIF found with MAC fa:16:3e:a4:6c:80, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:18:17 user nova-compute[72998]: DEBUG nova.network.neutron [req-beac4bb2-b808-4039-b60e-6304396aab20 req-930cbe4f-6a4a-416f-901d-8da8b0d3264a service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updated VIF entry in instance network info cache for port 1177fb3c-1f8f-489c-ada6-748478daa64b. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:18:17 user nova-compute[72998]: DEBUG nova.network.neutron [req-beac4bb2-b808-4039-b60e-6304396aab20 req-930cbe4f-6a4a-416f-901d-8da8b0d3264a service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating instance_info_cache with network_info: [{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:18:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-beac4bb2-b808-4039-b60e-6304396aab20 req-930cbe4f-6a4a-416f-901d-8da8b0d3264a service nova] Releasing lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:18:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:18 user nova-compute[72998]: DEBUG nova.compute.manager [req-a0d4d70f-f99b-435a-89fd-472df40850e3 req-ad4b589e-6e12-48b1-bcdb-5c8546e145db service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a0d4d70f-f99b-435a-89fd-472df40850e3 req-ad4b589e-6e12-48b1-bcdb-5c8546e145db service nova] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a0d4d70f-f99b-435a-89fd-472df40850e3 req-ad4b589e-6e12-48b1-bcdb-5c8546e145db service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a0d4d70f-f99b-435a-89fd-472df40850e3 req-ad4b589e-6e12-48b1-bcdb-5c8546e145db service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:18 user nova-compute[72998]: DEBUG nova.compute.manager [req-a0d4d70f-f99b-435a-89fd-472df40850e3 req-ad4b589e-6e12-48b1-bcdb-5c8546e145db service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] No waiting events found dispatching network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:18 user nova-compute[72998]: WARNING nova.compute.manager [req-a0d4d70f-f99b-435a-89fd-472df40850e3 req-ad4b589e-6e12-48b1-bcdb-5c8546e145db service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received unexpected event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b for instance with vm_state building and task_state spawning.
Aug 17 08:18:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260300.8510907, 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:20 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] VM Resumed (Lifecycle Event)
Aug 17 08:18:20 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance spawned successfully.
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:18:20 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260300.8552122, 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:20 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] VM Started (Lifecycle Event)
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-36e764b4-f5b1-4e28-8e32-1db819ace93b req-95ed9544-10b8-43b2-b02e-ce2c2f0676d4 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-36e764b4-f5b1-4e28-8e32-1db819ace93b req-95ed9544-10b8-43b2-b02e-ce2c2f0676d4 service nova] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-36e764b4-f5b1-4e28-8e32-1db819ace93b req-95ed9544-10b8-43b2-b02e-ce2c2f0676d4 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-36e764b4-f5b1-4e28-8e32-1db819ace93b req-95ed9544-10b8-43b2-b02e-ce2c2f0676d4 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-36e764b4-f5b1-4e28-8e32-1db819ace93b req-95ed9544-10b8-43b2-b02e-ce2c2f0676d4 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] No waiting events found dispatching network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:20 user nova-compute[72998]: WARNING nova.compute.manager [req-36e764b4-f5b1-4e28-8e32-1db819ace93b req-95ed9544-10b8-43b2-b02e-ce2c2f0676d4 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received unexpected event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b for instance with vm_state building and task_state spawning.
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:18:20 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:18:21 user nova-compute[72998]: INFO nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Took 6.92 seconds to spawn the instance on the hypervisor.
Aug 17 08:18:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:21 user nova-compute[72998]: INFO nova.compute.manager [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Took 7.71 seconds to build instance.
Aug 17 08:18:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-63dd0567-185d-4980-a5f0-a5d782d11cf8 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.858s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:35 user nova-compute[72998]: INFO nova.compute.manager [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Terminating instance
Aug 17 08:18:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-39192f30-9b9a-4ee6-a8ba-9c4296e757ea req-54f719d4-f24f-4807-8717-2bfeb7026f66 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received event network-vif-unplugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-39192f30-9b9a-4ee6-a8ba-9c4296e757ea req-54f719d4-f24f-4807-8717-2bfeb7026f66 service nova] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-39192f30-9b9a-4ee6-a8ba-9c4296e757ea req-54f719d4-f24f-4807-8717-2bfeb7026f66 service nova] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-39192f30-9b9a-4ee6-a8ba-9c4296e757ea req-54f719d4-f24f-4807-8717-2bfeb7026f66 service nova] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-39192f30-9b9a-4ee6-a8ba-9c4296e757ea req-54f719d4-f24f-4807-8717-2bfeb7026f66 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] No waiting events found dispatching network-vif-unplugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-39192f30-9b9a-4ee6-a8ba-9c4296e757ea req-54f719d4-f24f-4807-8717-2bfeb7026f66 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received event network-vif-unplugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:18:35 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Instance destroyed successfully.
Aug 17 08:18:35 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lazy-loading 'resources' on Instance uuid c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1706195134',display_name='tempest-TestVolumeSwap-server-1706195134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1706195134',id=10,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSYjrjF+auphKaTkK/IDWDfl9supA+Yf4yKeRWCXgDIbyVDWDpgynVL4QZScWX1w5q3dbJiRF0IerBxQydtqTuiBmsNmhlu1zc/nkQDg7W9ZHqQ7H5ko+9q9pEEhvzsYQ==',key_name='tempest-keypair-475592770',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af73da99c7d042268ba6235903b69dbe',ramdisk_id='',reservation_id='r-dqsnjlp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-697446545',owner_user_name='tempest-TestVolumeSwap-697446545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ba73641461482f9a108848958eaf85',uuid=c3d1e35d-0cec-451b-b0b8-c51fbfd78c37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:18:36 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Converting VIF {"id": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "address": "fa:16:3e:25:50:ea", "network": {"id": "518ecfbd-7567-4823-8dd3-8ab34acc7021", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1395610695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af73da99c7d042268ba6235903b69dbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ba726-b4", "ovs_interfaceid": "a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:18:36 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:50:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9,network=Network(518ecfbd-7567-4823-8dd3-8ab34acc7021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ba726-b4') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:18:36 user nova-compute[72998]: DEBUG os_vif [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:50:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9,network=Network(518ecfbd-7567-4823-8dd3-8ab34acc7021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ba726-b4') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:18:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa56ba726-b4, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:18:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:18:36 user nova-compute[72998]: INFO os_vif [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:50:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9,network=Network(518ecfbd-7567-4823-8dd3-8ab34acc7021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ba726-b4')
Aug 17 08:18:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Deleting instance files /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37_del
Aug 17 08:18:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Deletion of /opt/stack/data/nova/instances/c3d1e35d-0cec-451b-b0b8-c51fbfd78c37_del complete
Aug 17 08:18:36 user nova-compute[72998]: INFO nova.compute.manager [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 08:18:36 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:18:36 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:18:36 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:18:37 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Took 0.93 seconds to deallocate network for instance.
Aug 17 08:18:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-cb6b19a5-4739-435b-80ff-035fa35f05fb req-d47445f2-e108-45c0-b8ef-f8db0f94021c service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received event network-vif-deleted-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:37 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Deleted allocations for instance c3d1e35d-0cec-451b-b0b8-c51fbfd78c37
Aug 17 08:18:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e9e25819-5e2e-42fa-ad95-74cb6ff5f67e tempest-TestVolumeSwap-697446545 tempest-TestVolumeSwap-697446545-project-member] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-93a0cff7-a779-46ac-8b01-f126c813c6e5 req-bb3f138c-0225-4919-8af0-a004c71a5368 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received event network-vif-plugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-93a0cff7-a779-46ac-8b01-f126c813c6e5 req-bb3f138c-0225-4919-8af0-a004c71a5368 service nova] Acquiring lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-93a0cff7-a779-46ac-8b01-f126c813c6e5 req-bb3f138c-0225-4919-8af0-a004c71a5368 service nova] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-93a0cff7-a779-46ac-8b01-f126c813c6e5 req-bb3f138c-0225-4919-8af0-a004c71a5368 service nova] Lock "c3d1e35d-0cec-451b-b0b8-c51fbfd78c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-93a0cff7-a779-46ac-8b01-f126c813c6e5 req-bb3f138c-0225-4919-8af0-a004c71a5368 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] No waiting events found dispatching network-vif-plugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:37 user nova-compute[72998]: WARNING nova.compute.manager [req-93a0cff7-a779-46ac-8b01-f126c813c6e5 req-bb3f138c-0225-4919-8af0-a004c71a5368 service nova] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Received unexpected event network-vif-plugged-a56ba726-b4aa-4f7d-b3ac-a27a0c6ae4d9 for instance with vm_state deleted and task_state None.
Aug 17 08:18:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:50 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260315.9883995, c3d1e35d-0cec-451b-b0b8-c51fbfd78c37 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:18:50 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] VM Stopped (Lifecycle Event)
Aug 17 08:18:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f487d036-b089-4162-be76-1c9cf5d953f9 None None] [instance: c3d1e35d-0cec-451b-b0b8-c51fbfd78c37] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:18:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:54 user nova-compute[72998]: INFO nova.compute.manager [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Rescuing
Aug 17 08:18:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:18:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquired lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:18:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:18:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updating instance_info_cache with network_info: [{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Releasing lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-7802c357-76b2-4d8f-9a1e-634302220f5a req-f51de9e8-ce92-484b-90f3-7d5392b11e92 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-unplugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7802c357-76b2-4d8f-9a1e-634302220f5a req-f51de9e8-ce92-484b-90f3-7d5392b11e92 service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7802c357-76b2-4d8f-9a1e-634302220f5a req-f51de9e8-ce92-484b-90f3-7d5392b11e92 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7802c357-76b2-4d8f-9a1e-634302220f5a req-f51de9e8-ce92-484b-90f3-7d5392b11e92 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-7802c357-76b2-4d8f-9a1e-634302220f5a req-f51de9e8-ce92-484b-90f3-7d5392b11e92 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-unplugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:55 user nova-compute[72998]: WARNING nova.compute.manager [req-7802c357-76b2-4d8f-9a1e-634302220f5a req-f51de9e8-ce92-484b-90f3-7d5392b11e92 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-unplugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state active and task_state rescuing.
Aug 17 08:18:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Instance destroyed successfully.
Aug 17 08:18:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Attempting rescue
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72998) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Instance directory exists: not creating {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 08:18:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Creating image(s)
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.231s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue" returned: 0 in 0.048s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'migration_context' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Start _get_guest_xml network_info=[{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "vif_mac": "fa:16:3e:55:53:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'resources' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:18:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1188743299',display_name='tempest-ServerRescueNegativeTestJSON-server-1188743299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1188743299',id=2,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-ixwnw5mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:14:27Z,user_data=None,user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=0d992c9b-66c8-4bd9-b78e-51e13d662144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "vif_mac": "fa:16:3e:55:53:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "vif_mac": "fa:16:3e:55:53:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:53:e1,bridge_name='br-int',has_traffic_filtering=True,id=75d77dae-ff35-4dee-a471-39e1476dd39e,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d77dae-ff') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:18:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:18:56 user nova-compute[72998]:   <uuid>0d992c9b-66c8-4bd9-b78e-51e13d662144</uuid>
Aug 17 08:18:56 user nova-compute[72998]:   <name>instance-00000002</name>
Aug 17 08:18:56 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:18:56 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:18:56 user nova-compute[72998]:   <metadata>
Aug 17 08:18:56 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:18:56 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:18:56 user nova-compute[72998]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1188743299</nova:name>
Aug 17 08:18:56 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:18:56</nova:creationTime>
Aug 17 08:18:56 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:18:56 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:18:56 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:18:56 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:18:56 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:18:56 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:18:56 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:18:56 user nova-compute[72998]:       <nova:owner>
Aug 17 08:18:56 user nova-compute[72998]:         <nova:user uuid="4cf59502a7ee46968534c860fc9f49f5">tempest-ServerRescueNegativeTestJSON-826615417-project-member</nova:user>
Aug 17 08:18:56 user nova-compute[72998]:         <nova:project uuid="8eaaef9c2492458bbe646bd227b11b64">tempest-ServerRescueNegativeTestJSON-826615417</nova:project>
Aug 17 08:18:56 user nova-compute[72998]:       </nova:owner>
Aug 17 08:18:56 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:18:56 user nova-compute[72998]:       <nova:ports>
Aug 17 08:18:56 user nova-compute[72998]:         <nova:port uuid="75d77dae-ff35-4dee-a471-39e1476dd39e">
Aug 17 08:18:56 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 08:18:56 user nova-compute[72998]:         </nova:port>
Aug 17 08:18:56 user nova-compute[72998]:       </nova:ports>
Aug 17 08:18:56 user nova-compute[72998]:     </nova:instance>
Aug 17 08:18:56 user nova-compute[72998]:   </metadata>
Aug 17 08:18:56 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:18:56 user nova-compute[72998]:     <system>
Aug 17 08:18:56 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:18:56 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:18:56 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:18:56 user nova-compute[72998]:       <entry name="serial">0d992c9b-66c8-4bd9-b78e-51e13d662144</entry>
Aug 17 08:18:56 user nova-compute[72998]:       <entry name="uuid">0d992c9b-66c8-4bd9-b78e-51e13d662144</entry>
Aug 17 08:18:56 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:18:56 user nova-compute[72998]:     </system>
Aug 17 08:18:56 user nova-compute[72998]:   </sysinfo>
Aug 17 08:18:56 user nova-compute[72998]:   <os>
Aug 17 08:18:56 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:18:56 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:18:56 user nova-compute[72998]:   </os>
Aug 17 08:18:56 user nova-compute[72998]:   <features>
Aug 17 08:18:56 user nova-compute[72998]:     <acpi/>
Aug 17 08:18:56 user nova-compute[72998]:     <apic/>
Aug 17 08:18:56 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:18:56 user nova-compute[72998]:   </features>
Aug 17 08:18:56 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:18:56 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:18:56 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:18:56 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:18:56 user nova-compute[72998]:   </clock>
Aug 17 08:18:56 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:18:56 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:18:56 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:18:56 user nova-compute[72998]:   </cpu>
Aug 17 08:18:56 user nova-compute[72998]:   <devices>
Aug 17 08:18:56 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:18:56 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:18:56 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue"/>
Aug 17 08:18:56 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:18:56 user nova-compute[72998]:     </disk>
Aug 17 08:18:56 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:18:56 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:18:56 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk"/>
Aug 17 08:18:56 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:18:56 user nova-compute[72998]:     </disk>
Aug 17 08:18:56 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:18:56 user nova-compute[72998]:       <mac address="fa:16:3e:55:53:e1"/>
Aug 17 08:18:56 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:18:56 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:18:56 user nova-compute[72998]:       <target dev="tap75d77dae-ff"/>
Aug 17 08:18:56 user nova-compute[72998]:     </interface>
Aug 17 08:18:56 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:18:56 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/console.log" append="off"/>
Aug 17 08:18:56 user nova-compute[72998]:     </serial>
Aug 17 08:18:56 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:18:56 user nova-compute[72998]:     <video>
Aug 17 08:18:56 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:18:56 user nova-compute[72998]:     </video>
Aug 17 08:18:56 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:18:56 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:18:56 user nova-compute[72998]:     </rng>
Aug 17 08:18:56 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:18:56 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:18:56 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:18:56 user nova-compute[72998]:     </memballoon>
Aug 17 08:18:56 user nova-compute[72998]:   </devices>
Aug 17 08:18:56 user nova-compute[72998]: </domain>
Aug 17 08:18:56 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:18:57 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Instance destroyed successfully.
Aug 17 08:18:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:18:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:18:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No VIF found with MAC fa:16:3e:55:53:e1, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:18:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-13ef7902-a4ae-459c-8558-c50f403887fe req-d828a161-7bb2-4bcd-a891-c29481e48e31 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:18:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-13ef7902-a4ae-459c-8558-c50f403887fe req-d828a161-7bb2-4bcd-a891-c29481e48e31 service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:18:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-13ef7902-a4ae-459c-8558-c50f403887fe req-d828a161-7bb2-4bcd-a891-c29481e48e31 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:18:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-13ef7902-a4ae-459c-8558-c50f403887fe req-d828a161-7bb2-4bcd-a891-c29481e48e31 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:18:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-13ef7902-a4ae-459c-8558-c50f403887fe req-d828a161-7bb2-4bcd-a891-c29481e48e31 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:18:57 user nova-compute[72998]: WARNING nova.compute.manager [req-13ef7902-a4ae-459c-8558-c50f403887fe req-d828a161-7bb2-4bcd-a891-c29481e48e31 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state active and task_state rescuing.
Aug 17 08:18:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:18:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:18:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:18:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:19:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for 0d992c9b-66c8-4bd9-b78e-51e13d662144 due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:19:00 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260340.7095122, 0d992c9b-66c8-4bd9-b78e-51e13d662144 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:19:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] VM Resumed (Lifecycle Event)
Aug 17 08:19:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-60c9b725-f9b3-47cd-9d54-841726173c08 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:19:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:19:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:19:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 08:19:00 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260340.7143092, 0d992c9b-66c8-4bd9-b78e-51e13d662144 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:19:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] VM Started (Lifecycle Event)
Aug 17 08:19:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:19:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:19:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:19:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-f7af08c8-c7fe-4d85-9dc6-65fc9f35deae req-db5a9084-060c-41b7-bfad-5566d4f33ec6 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7af08c8-c7fe-4d85-9dc6-65fc9f35deae req-db5a9084-060c-41b7-bfad-5566d4f33ec6 service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7af08c8-c7fe-4d85-9dc6-65fc9f35deae req-db5a9084-060c-41b7-bfad-5566d4f33ec6 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7af08c8-c7fe-4d85-9dc6-65fc9f35deae req-db5a9084-060c-41b7-bfad-5566d4f33ec6 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-f7af08c8-c7fe-4d85-9dc6-65fc9f35deae req-db5a9084-060c-41b7-bfad-5566d4f33ec6 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:19:02 user nova-compute[72998]: WARNING nova.compute.manager [req-f7af08c8-c7fe-4d85-9dc6-65fc9f35deae req-db5a9084-060c-41b7-bfad-5566d4f33ec6 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state rescued and task_state None.
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-ab95a2f8-9db7-4bd4-a857-1aeb7d94b738 req-c945bd7f-313d-4cdf-97f0-760b230d8946 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ab95a2f8-9db7-4bd4-a857-1aeb7d94b738 req-c945bd7f-313d-4cdf-97f0-760b230d8946 service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ab95a2f8-9db7-4bd4-a857-1aeb7d94b738 req-c945bd7f-313d-4cdf-97f0-760b230d8946 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ab95a2f8-9db7-4bd4-a857-1aeb7d94b738 req-c945bd7f-313d-4cdf-97f0-760b230d8946 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-ab95a2f8-9db7-4bd4-a857-1aeb7d94b738 req-c945bd7f-313d-4cdf-97f0-760b230d8946 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:19:04 user nova-compute[72998]: WARNING nova.compute.manager [req-ab95a2f8-9db7-4bd4-a857-1aeb7d94b738 req-c945bd7f-313d-4cdf-97f0-760b230d8946 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state rescued and task_state None.
Aug 17 08:19:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6ba9a29-fac3-4210-985f-61c467e5b22d req-16f18b50-449e-4111-adca-fdf433b02f54 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received event network-changed-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6ba9a29-fac3-4210-985f-61c467e5b22d req-16f18b50-449e-4111-adca-fdf433b02f54 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Refreshing instance network info cache due to event network-changed-85f6bd9d-2413-407d-9172-9fd50266255a. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6ba9a29-fac3-4210-985f-61c467e5b22d req-16f18b50-449e-4111-adca-fdf433b02f54 service nova] Acquiring lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6ba9a29-fac3-4210-985f-61c467e5b22d req-16f18b50-449e-4111-adca-fdf433b02f54 service nova] Acquired lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.network.neutron [req-f6ba9a29-fac3-4210-985f-61c467e5b22d req-16f18b50-449e-4111-adca-fdf433b02f54 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Refreshing network info cache for port 85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:07 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:19:07 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7483MB free_disk=24.493080139160156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cfbd3131-e61b-45a4-8c69-91081320f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 794e686e-2e6a-42f5-b817-5d18d2ad705e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance f79a3323-477f-4689-b8e3-35f2ff59a641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 70d270c8-e0fc-4b40-a2c9-95dd23316853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:19:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'flavor' on Instance uuid cfbd3131-e61b-45a4-8c69-91081320f046 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:08 user nova-compute[72998]: INFO nova.compute.manager [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Attaching volume 860a7ab8-e65f-4ee9-b9d4-22844f550601 to /dev/vdb
Aug 17 08:19:08 user nova-compute[72998]: DEBUG os_brick.utils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1297e8-1fd7-4ea5-b53d-762f4ebef05d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cf86c2-0e1a-422e-a240-bc7f86690a46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[36923096-e4bc-4f18-9931-26d479869ce2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[24208175-66d7-4916-b0ed-f26577c28edf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:08 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e07d619-e083-447e-a91b-09197f737517]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG os_brick.utils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updating existing volume attachment record: 39a11b83-487c-470d-8e33-63ab715cc0a6 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-f6ba9a29-fac3-4210-985f-61c467e5b22d req-16f18b50-449e-4111-adca-fdf433b02f54 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updated VIF entry in instance network info cache for port 85f6bd9d-2413-407d-9172-9fd50266255a. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-f6ba9a29-fac3-4210-985f-61c467e5b22d req-16f18b50-449e-4111-adca-fdf433b02f54 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updating instance_info_cache with network_info: [{"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6ba9a29-fac3-4210-985f-61c467e5b22d req-16f18b50-449e-4111-adca-fdf433b02f54 service nova] Releasing lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:19:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:19:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:19:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:19:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:19:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbULOzJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:19:23 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:19:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:19:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:19:23 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:19:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:19:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:19:23 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:19:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fd02d8-bc77-48ee-bbf9-040f5d5da923]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:19:23 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8e6a28-d993-435d-bea8-f5de1a4980cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601] added
Aug 17 08:19:24 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5279b6a-8e47-4e0d-9885-cd32983450eb]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eccbe3-eefb-4316-be21-8df6e309f989]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XbULOzJs {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XbULOzJs" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2230bbf7-c944-42a8-baf9-3f3c783900c3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XbULOzJs'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebccf39-5a30-4442-9209-b78c268edf96]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[707ac936-32a8-4a21-be5e-56165f4cd6f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:19:24 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:19:24 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:19:24 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:19:24 user nova-compute[72998]: 
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dcc11e-8273-441f-acff-20efcde0fdbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601, portal: 172.16.0.220,3260]
Aug 17 08:19:24 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601, portal: 172.16.0.220,3260] successful.
Aug 17 08:19:24 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f934b-e658-424c-bb8a-0072abb9b507]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed46aa53-110a-40e7-ab8e-79634a645ad9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 (non-flash)
Aug 17 08:19:24 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 (non-flash)
Aug 17 08:19:24 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057253b-134f-4ad7-bfd8-7a35330793fc]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:19:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbULOzJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23336633362623561', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336633362623561', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'flavor' on Instance uuid cfbd3131-e61b-45a4-8c69-91081320f046 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:19:25 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:19:25 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:19:25 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:19:25 user nova-compute[72998]:   <serial>860a7ab8-e65f-4ee9-b9d4-22844f550601</serial>
Aug 17 08:19:25 user nova-compute[72998]: </disk>
Aug 17 08:19:25 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No VIF found with MAC fa:16:3e:99:3d:e0, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:19:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b77ef66-6718-445f-9d22-a2ac2750c2e7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.393s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:28 user nova-compute[72998]: INFO nova.compute.manager [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Detaching volume 860a7ab8-e65f-4ee9-b9d4-22844f550601
Aug 17 08:19:28 user nova-compute[72998]: INFO nova.virt.block_device [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Attempting to driver detach volume 860a7ab8-e65f-4ee9-b9d4-22844f550601 from mountpoint /dev/vdb
Aug 17 08:19:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Attempting to detach device vdb from instance cfbd3131-e61b-45a4-8c69-91081320f046 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:19:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:19:28 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:19:28 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:19:28 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:19:28 user nova-compute[72998]:   <serial>860a7ab8-e65f-4ee9-b9d4-22844f550601</serial>
Aug 17 08:19:28 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:19:28 user nova-compute[72998]: </disk>
Aug 17 08:19:28 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:19:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Successfully detached device vdb from instance cfbd3131-e61b-45a4-8c69-91081320f046 from the persistent domain config.
Aug 17 08:19:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cfbd3131-e61b-45a4-8c69-91081320f046 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:19:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:19:28 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:19:28 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:19:28 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:19:28 user nova-compute[72998]:   <serial>860a7ab8-e65f-4ee9-b9d4-22844f550601</serial>
Aug 17 08:19:28 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:19:28 user nova-compute[72998]: </disk>
Aug 17 08:19:28 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260369.307225, cfbd3131-e61b-45a4-8c69-91081320f046 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cfbd3131-e61b-45a4-8c69-91081320f046 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:19:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Successfully detached device vdb from instance cfbd3131-e61b-45a4-8c69-91081320f046 from the live domain config.
Aug 17 08:19:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbULOzJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:19:29 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a98e45-34ae-4e75-bd78-31fa285b7e0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6011eb-e31c-4ad1-a968-702ed3332da7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 (non-flash)
Aug 17 08:19:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 (non-flash)
Aug 17 08:19:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa48824e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37aa2c7-92c1-4921-a5ae-b6c818712515]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ccd088-66ea-4788-853b-946d9a05735e]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc4cece-990f-43db-bbc5-b644d1e016f4]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7727f87-926d-4eda-92d8-0c0fc76bb101]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[342bb7f0-8131-4275-aa07-3d9a4f04b226]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b4fd67-01e2-4b81-aea6-fab4a5fa608a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601, portal: 172.16.0.220,3260]
Aug 17 08:19:29 user nova-compute[72998]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601, portal: 172.16.0.220,3260] successful.
Aug 17 08:19:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:860a7ab8-e65f-4ee9-b9d4-22844f550601 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f76f35-4723-4345-bf6e-5de1718f49eb]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] <== disconnect_volume: return (275ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:19:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:19:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'flavor' on Instance uuid cfbd3131-e61b-45a4-8c69-91081320f046 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:19:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-453d2657-64ea-4394-a364-95246ea6612d tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.382s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:19:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:39 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:19:39 user nova-compute[72998]: INFO nova.compute.claims [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Claim successful on node user
Aug 17 08:19:39 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:19:39 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:19:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:19:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:19:40 user nova-compute[72998]: INFO nova.virt.block_device [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Booting with volume 3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 at /dev/vda
Aug 17 08:19:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG os_brick.utils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb972a1-c143-4fbd-a36d-56c006a9518c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a274664-4799-453a-ae3f-51f928f3b133]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[609336e1-62e5-40ab-838c-159b8cb6166a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21721fb-7e00-4f96-b4d7-f864ebcfed6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:40 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:19:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d58afbc-c3a8-4a60-b93c-5e7d65f2b4f0]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG os_brick.utils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating existing volume attachment record: c225b873-dc3e-40dd-b85f-29987f40e52b {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:19:40 user nova-compute[72998]: DEBUG nova.policy [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5c3bceee1c54e19bad334ee473e4889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e98f8721de96438582bae61d057d202b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:19:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully created port: dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully created port: 2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-3eeb5f93-1cf5-45b8-b65c-5e0190130a9d req-09a2b28a-5c9c-4561-ac46-82f127f5cb5f service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-changed-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-3eeb5f93-1cf5-45b8-b65c-5e0190130a9d req-09a2b28a-5c9c-4561-ac46-82f127f5cb5f service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Refreshing instance network info cache due to event network-changed-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3eeb5f93-1cf5-45b8-b65c-5e0190130a9d req-09a2b28a-5c9c-4561-ac46-82f127f5cb5f service nova] Acquiring lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3eeb5f93-1cf5-45b8-b65c-5e0190130a9d req-09a2b28a-5c9c-4561-ac46-82f127f5cb5f service nova] Acquired lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:42 user nova-compute[72998]: DEBUG nova.network.neutron [req-3eeb5f93-1cf5-45b8-b65c-5e0190130a9d req-09a2b28a-5c9c-4561-ac46-82f127f5cb5f service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Refreshing network info cache for port 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully created port: ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-3eeb5f93-1cf5-45b8-b65c-5e0190130a9d req-09a2b28a-5c9c-4561-ac46-82f127f5cb5f service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updated VIF entry in instance network info cache for port 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:19:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-3eeb5f93-1cf5-45b8-b65c-5e0190130a9d req-09a2b28a-5c9c-4561-ac46-82f127f5cb5f service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating instance_info_cache with network_info: [{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3eeb5f93-1cf5-45b8-b65c-5e0190130a9d req-09a2b28a-5c9c-4561-ac46-82f127f5cb5f service nova] Releasing lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:43 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully created port: 7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:19:43 user nova-compute[72998]: INFO nova.compute.manager [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] instance snapshotting
Aug 17 08:19:43 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Beginning live snapshot process
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json -f qcow2 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json -f qcow2 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-251594d4-1323-43b7-87a6-70c0dab8cb89 req-44600e45-4653-4bf4-9210-6662a592964a service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-changed-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-251594d4-1323-43b7-87a6-70c0dab8cb89 req-44600e45-4653-4bf4-9210-6662a592964a service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Refreshing instance network info cache due to event network-changed-8cbeff07-8a68-46c9-92b4-58f4f07fb208. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-251594d4-1323-43b7-87a6-70c0dab8cb89 req-44600e45-4653-4bf4-9210-6662a592964a service nova] Acquiring lock "refresh_cache-f79a3323-477f-4689-b8e3-35f2ff59a641" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-251594d4-1323-43b7-87a6-70c0dab8cb89 req-44600e45-4653-4bf4-9210-6662a592964a service nova] Acquired lock "refresh_cache-f79a3323-477f-4689-b8e3-35f2ff59a641" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG nova.network.neutron [req-251594d4-1323-43b7-87a6-70c0dab8cb89 req-44600e45-4653-4bf4-9210-6662a592964a service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Refreshing network info cache for port 8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpos4pkzdr/595bf07bec884f1ca08883aa5ea8bd0e.delta 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpos4pkzdr/595bf07bec884f1ca08883aa5ea8bd0e.delta 1073741824" returned: 0 in 0.052s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:44 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG nova.network.neutron [req-251594d4-1323-43b7-87a6-70c0dab8cb89 req-44600e45-4653-4bf4-9210-6662a592964a service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Updated VIF entry in instance network info cache for port 8cbeff07-8a68-46c9-92b4-58f4f07fb208. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG nova.network.neutron [req-251594d4-1323-43b7-87a6-70c0dab8cb89 req-44600e45-4653-4bf4-9210-6662a592964a service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Updating instance_info_cache with network_info: [{"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG nova.objects.instance [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'flavor' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-251594d4-1323-43b7-87a6-70c0dab8cb89 req-44600e45-4653-4bf4-9210-6662a592964a service nova] Releasing lock "refresh_cache-f79a3323-477f-4689-b8e3-35f2ff59a641" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:45 user nova-compute[72998]: INFO nova.compute.manager [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Attaching volume c86f548e-92a7-4a7c-ac4e-fa659c203ad3 to /dev/vdb
Aug 17 08:19:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully created port: 735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c55bc1-effa-4bcc-b51e-b771fc7e10b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0306d675-d60d-4658-9ada-6a999942809f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8aefa7-9c5c-4705-98aa-8fb29fc9ae76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51c566-1fa3-40fb-944f-dc103d5830d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] COPY block job progress, current cursor: 327680 final cursor: 75497472 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:45 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:19:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[981bb550-0c62-471a-8601-ce234eaa43e0]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:19:45 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Updating existing volume attachment record: ecd98df9-d2ac-4c88-a3a4-7b8ab1aef849 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:19:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:19:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 08:19:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:46 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:19:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpos4pkzdr/595bf07bec884f1ca08883aa5ea8bd0e.delta /opt/stack/data/nova/instances/snapshots/tmpos4pkzdr/595bf07bec884f1ca08883aa5ea8bd0e {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpos4pkzdr/595bf07bec884f1ca08883aa5ea8bd0e.delta /opt/stack/data/nova/instances/snapshots/tmpos4pkzdr/595bf07bec884f1ca08883aa5ea8bd0e" returned: 0 in 0.730s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Snapshot extracted, beginning image upload
Aug 17 08:19:47 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully updated port: dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:19:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-84e95e75-d3c8-46cb-93eb-b73db206aa41 req-9ae07bfa-bc94-48fc-910c-fa56cffc5cc8 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-changed-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-84e95e75-d3c8-46cb-93eb-b73db206aa41 req-9ae07bfa-bc94-48fc-910c-fa56cffc5cc8 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing instance network info cache due to event network-changed-dfe13d48-2d8d-418b-bbd3-d2ee257689d6. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-84e95e75-d3c8-46cb-93eb-b73db206aa41 req-9ae07bfa-bc94-48fc-910c-fa56cffc5cc8 service nova] Acquiring lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-84e95e75-d3c8-46cb-93eb-b73db206aa41 req-9ae07bfa-bc94-48fc-910c-fa56cffc5cc8 service nova] Acquired lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:47 user nova-compute[72998]: DEBUG nova.network.neutron [req-84e95e75-d3c8-46cb-93eb-b73db206aa41 req-9ae07bfa-bc94-48fc-910c-fa56cffc5cc8 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing network info cache for port dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:47 user nova-compute[72998]: DEBUG nova.network.neutron [req-84e95e75-d3c8-46cb-93eb-b73db206aa41 req-9ae07bfa-bc94-48fc-910c-fa56cffc5cc8 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:19:48 user nova-compute[72998]: DEBUG nova.network.neutron [req-84e95e75-d3c8-46cb-93eb-b73db206aa41 req-9ae07bfa-bc94-48fc-910c-fa56cffc5cc8 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-84e95e75-d3c8-46cb-93eb-b73db206aa41 req-9ae07bfa-bc94-48fc-910c-fa56cffc5cc8 service nova] Releasing lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully updated port: 2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:19:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-758b5f8e-8e1a-46da-878f-215ed9a41741 req-0c853770-b577-4e16-9d45-1ee6ed1077de service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-changed-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-758b5f8e-8e1a-46da-878f-215ed9a41741 req-0c853770-b577-4e16-9d45-1ee6ed1077de service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing instance network info cache due to event network-changed-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-758b5f8e-8e1a-46da-878f-215ed9a41741 req-0c853770-b577-4e16-9d45-1ee6ed1077de service nova] Acquiring lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-758b5f8e-8e1a-46da-878f-215ed9a41741 req-0c853770-b577-4e16-9d45-1ee6ed1077de service nova] Acquired lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:49 user nova-compute[72998]: DEBUG nova.network.neutron [req-758b5f8e-8e1a-46da-878f-215ed9a41741 req-0c853770-b577-4e16-9d45-1ee6ed1077de service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing network info cache for port 2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully updated port: b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:19:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-758b5f8e-8e1a-46da-878f-215ed9a41741 req-0c853770-b577-4e16-9d45-1ee6ed1077de service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:19:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:50 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Snapshot image upload complete
Aug 17 08:19:50 user nova-compute[72998]: INFO nova.compute.manager [None req-d8fc69c6-e77f-4932-8b2a-af49b46d8cd7 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Took 6.48 seconds to snapshot the instance on the hypervisor.
Aug 17 08:19:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-758b5f8e-8e1a-46da-878f-215ed9a41741 req-0c853770-b577-4e16-9d45-1ee6ed1077de service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-758b5f8e-8e1a-46da-878f-215ed9a41741 req-0c853770-b577-4e16-9d45-1ee6ed1077de service nova] Releasing lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "24f6cff0-793a-48ae-bd48-b276e9580897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:19:51 user nova-compute[72998]: INFO nova.compute.claims [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Claim successful on node user
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully updated port: 2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-changed-b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing instance network info cache due to event network-changed-b1002575-29c6-47ba-b59a-f56301313413. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] Acquiring lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] Acquired lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.network.neutron [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing network info cache for port b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:51 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:19:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.network.neutron [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:19:52 user nova-compute[72998]: INFO nova.virt.block_device [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Booting with volume 3f91b5a5-ba2c-4844-851e-7f31b2b7d035 at /dev/vda
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.utils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[82518ddf-54a3-4527-87c8-4ce9e96e85c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.policy [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd037e26859554af98bbe00502a606744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83124dfa96344a56b27b2f89eeda1976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[50213b39-6d99-49d7-85a1-dc6e85c9bd09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[73258fb1-08e8-433f-a4fe-71aad36aef72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[acadc565-3777-4c94-9ff5-f3b570e07d48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:52 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2989330b-d410-45d1-bc11-b73f2b5b5e03]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.network.neutron [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.utils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating existing volume attachment record: 32726db3-73bf-4375-bf2a-b9147f03d6b0 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] Releasing lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-changed-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing instance network info cache due to event network-changed-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] Acquiring lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] Acquired lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.network.neutron [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing network info cache for port 2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.network.neutron [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:19:52 user nova-compute[72998]: INFO nova.virt.block_device [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Booting with volume f7033c41-a077-4de9-ab33-2544a6199b2e at /dev/vdb
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.utils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.network.neutron [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fef68b8-fe60-4e8d-b375-2f1c859028fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-630702c8-bb3f-451f-891f-b0e93c6940d4 req-b6c7de3e-3628-4844-b9c3-6506c61f02ac service nova] Releasing lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c80053-9585-4579-8938-bebf6c2336d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d67214-0a51-4966-b920-5408f9ae7b48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f622532-8d7f-4347-bb92-92696ca8d9a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully updated port: ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:19:52 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:19:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc90dcef-9742-47b7-8896-9c50fb72945d]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG os_brick.utils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:19:52 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating existing volume attachment record: ac52f977-3ae8-4cf3-a90c-ab9a63c1c9b8 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:19:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully created port: f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully updated port: 7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:19:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully created port: 1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-changed-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing instance network info cache due to event network-changed-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] Acquiring lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] Acquired lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:53 user nova-compute[72998]: DEBUG nova.network.neutron [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing network info cache for port ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] Releasing lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-changed-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing instance network info cache due to event network-changed-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] Acquiring lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] Acquired lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing network info cache for port 7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Successfully updated port: 735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:19:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:55 user nova-compute[72998]: DEBUG nova.network.neutron [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b0d43836-a33e-4473-8fcf-3e1695d2f4f5 req-101a1fc6-48e2-44a1-82d6-7cc1fa648b19 service nova] Releasing lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquired lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:19:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:19:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully created port: ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-5e786370-a352-4d86-93db-327f096c18ab req-cb26a8db-212e-414d-af65-4819b7609d37 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-changed-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:19:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-5e786370-a352-4d86-93db-327f096c18ab req-cb26a8db-212e-414d-af65-4819b7609d37 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing instance network info cache due to event network-changed-735cd582-44ee-4a10-ab3d-529677296802. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:19:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5e786370-a352-4d86-93db-327f096c18ab req-cb26a8db-212e-414d-af65-4819b7609d37 service nova] Acquiring lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:19:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:19:56 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully created port: 0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtRFOwAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:19:57 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:19:57 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:19:57 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c33d479-a2fe-4342-ab60-de264f295fb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:19:57 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2514f4-fae8-4320-9f71-ef04d297eed8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3] added
Aug 17 08:19:57 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dd390e-2d05-491b-931f-e2bab1b4b4d7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b573ea8c-8f2c-4564-aea6-afb6356df9f6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtRFOwAE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtRFOwAE" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d407d7-35bb-42b3-923c-5b90df177694]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VtRFOwAE'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e091553-54c5-4160-b8cb-42ac4d3b9fd1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c40149e-a49b-4000-8170-38031e5d4fe5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:19:57 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:19:57 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:19:57 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:19:57 user nova-compute[72998]: 
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca984f-111b-4507-8fad-1e2d02230eaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260]
Aug 17 08:19:57 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260] successful.
Aug 17 08:19:57 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd958e0-c786-40f4-ad54-36affb25ba43]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3251fd-aba7-4e81-b7a7-86fe97d15090]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:19:57 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:19:57 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cf08dc-f666-4499-a39e-cfdf5580899b]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:19:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtRFOwAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:19:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully created port: af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:19:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:19:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23833383734343136', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:19:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833383734343136', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:19:58 user nova-compute[72998]: DEBUG nova.objects.instance [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'flavor' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:19:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:19:58 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:19:58 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:19:58 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:19:58 user nova-compute[72998]:   <serial>c86f548e-92a7-4a7c-ac4e-fa659c203ad3</serial>
Aug 17 08:19:58 user nova-compute[72998]: </disk>
Aug 17 08:19:58 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [{"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Releasing lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance network_info: |[{"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5e786370-a352-4d86-93db-327f096c18ab req-cb26a8db-212e-414d-af65-4819b7609d37 service nova] Acquired lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG nova.network.neutron [req-5e786370-a352-4d86-93db-327f096c18ab req-cb26a8db-212e-414d-af65-4819b7609d37 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing network info cache for port 735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No VIF found with MAC fa:16:3e:aa:80:db, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-52a1c26e-e5e1-4bc1-8fee-db5353bc8cb9 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.394s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:19:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-5e786370-a352-4d86-93db-327f096c18ab req-cb26a8db-212e-414d-af65-4819b7609d37 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updated VIF entry in instance network info cache for port 735cd582-44ee-4a10-ab3d-529677296802. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-5e786370-a352-4d86-93db-327f096c18ab req-cb26a8db-212e-414d-af65-4819b7609d37 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [{"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully updated port: f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5e786370-a352-4d86-93db-327f096c18ab req-cb26a8db-212e-414d-af65-4819b7609d37 service nova] Releasing lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-9d841d6a-0b73-44dd-9325-4b4c32c05369 req-260ea6ff-af71-4f41-983a-012d256bd9ef service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-changed-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-9d841d6a-0b73-44dd-9325-4b4c32c05369 req-260ea6ff-af71-4f41-983a-012d256bd9ef service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing instance network info cache due to event network-changed-f8f7f651-7001-4a2f-9a3f-845df27fb248. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9d841d6a-0b73-44dd-9325-4b4c32c05369 req-260ea6ff-af71-4f41-983a-012d256bd9ef service nova] Acquiring lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9d841d6a-0b73-44dd-9325-4b4c32c05369 req-260ea6ff-af71-4f41-983a-012d256bd9ef service nova] Acquired lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-9d841d6a-0b73-44dd-9325-4b4c32c05369 req-260ea6ff-af71-4f41-983a-012d256bd9ef service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing network info cache for port f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-9d841d6a-0b73-44dd-9325-4b4c32c05369 req-260ea6ff-af71-4f41-983a-012d256bd9ef service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-9d841d6a-0b73-44dd-9325-4b4c32c05369 req-260ea6ff-af71-4f41-983a-012d256bd9ef service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9d841d6a-0b73-44dd-9325-4b4c32c05369 req-260ea6ff-af71-4f41-983a-012d256bd9ef service nova] Releasing lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Skipping network cache update for instance because it is Building. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 08:20:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Skipping network cache update for instance because it is Building. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 08:20:00 user nova-compute[72998]: INFO nova.compute.manager [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Rebuilding instance
Aug 17 08:20:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid e2b811f8-19a3-4b50-8ea9-6d3442c38819 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'trusted_certs' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'pci_requests' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'pci_devices' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'resources' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'migration_context' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72998) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully updated port: 45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:20:02 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Instance destroyed successfully.
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-changed-45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing instance network info cache due to event network-changed-45f6182c-0023-4956-b6c9-69cf1980698c. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] Acquiring lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] Acquired lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.network.neutron [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing network info cache for port 45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:02 user nova-compute[72998]: INFO nova.compute.manager [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Detaching volume c86f548e-92a7-4a7c-ac4e-fa659c203ad3
Aug 17 08:20:02 user nova-compute[72998]: INFO nova.virt.block_device [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Attempting to driver detach volume c86f548e-92a7-4a7c-ac4e-fa659c203ad3 from mountpoint /dev/vdb
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.network.neutron [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Attempting to detach device vdb from instance f79a3323-477f-4689-b8e3-35f2ff59a641 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:20:02 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:20:02 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:20:02 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:20:02 user nova-compute[72998]:   <serial>c86f548e-92a7-4a7c-ac4e-fa659c203ad3</serial>
Aug 17 08:20:02 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:20:02 user nova-compute[72998]: </disk>
Aug 17 08:20:02 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updating instance_info_cache with network_info: [{"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:02 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully detached device vdb from instance f79a3323-477f-4689-b8e3-35f2ff59a641 from the persistent domain config.
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtRFOwAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:02 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bb2c9c-69de-4a93-8f98-0543aa32d8b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e1b7c6-3577-48c3-b1cd-47ba64088737]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4885a7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72311bb-8824-4885-ba22-b9f9f2965024]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ee303-5b2a-48af-a4a6-31d914bf1c3c]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0597e40d-1583-4749-a760-444400cf7ac7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1461e1f9-9b30-470b-9386-4bd556e2b506]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dde7839-cb1a-45f9-a47f-874d675e3459]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.network.neutron [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] Releasing lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-unplugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] No waiting events found dispatching network-vif-unplugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:02 user nova-compute[72998]: WARNING nova.compute.manager [req-dab3e391-e396-42fa-96b9-7cc1d814d6f4 req-0c5e896b-e95c-44ee-95c8-27e66df456e5 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received unexpected event network-vif-unplugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 for instance with vm_state active and task_state rebuilding.
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[27af3918-9570-4aa2-9a3b-65a4bf73817f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260]
Aug 17 08:20:02 user nova-compute[72998]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260] successful.
Aug 17 08:20:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac58c2-3d0a-4945-b619-4c0297d79620]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== disconnect_volume: return (302ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:20:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully updated port: e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:20:03 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Instance destroyed successfully.
Aug 17 08:20:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-649770025',display_name='tempest-ServerActionsTestOtherA-server-21228523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-649770025',id=13,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkgz6KIvkjo7YISoQuK0gKb5worGqa3M96YDdoFGvE2t+BrFcgavSDbwPCbWbcUEBpB4d8lGQtJpxdLC26DtEQzWbxv/vhiZjqnt3G/kF8kNKY2c+leCXryY3xsQnrvtA==',key_name='tempest-keypair-1697256322',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-lz1l9ivg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=f79a3323-477f-4689-b8e3-35f2ff59a641,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_vif [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cbeff07-8a, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:03 user nova-compute[72998]: INFO os_vif [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a')
Aug 17 08:20:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtRFOwAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:03 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c406f4cf-79ee-48dc-9bdc-e70f351d9e79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:03 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 17 08:20:03 user nova-compute[72998]: : NotImplementedError
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f963219-9fc3-440a-bf72-3957194dc873]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:20:03 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:20:03 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:03 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:20:03 user nova-compute[72998]: : NotImplementedError
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4b572b7f0>, {}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Disconnecting from: [] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== disconnect_volume: return (54ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:20:03 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Deleting instance files /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641_del
Aug 17 08:20:03 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Deletion of /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641_del complete
Aug 17 08:20:03 user nova-compute[72998]: INFO nova.virt.block_device [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Booting with volume c86f548e-92a7-4a7c-ac4e-fa659c203ad3 at /dev/vdb
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.utils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb6ce06-005e-439a-b1ec-d95413b0c881]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e764174a-4583-42ad-bce3-06a26faace4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bf5632-9c4e-4f9c-9210-57e2ed24a93b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[935a904e-ebfd-4054-9e38-9cedbfc27d0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:20:03 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:20:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e7764e-f5c3-47b2-9351-c1f77fde7e72]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG os_brick.utils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:03 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Updating existing volume attachment record: 3e30f354-53fa-4121-b7a1-b86a4d7ff573 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] No waiting events found dispatching network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:04 user nova-compute[72998]: WARNING nova.compute.manager [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received unexpected event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 17 08:20:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-changed-e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing instance network info cache due to event network-changed-e7b6ef84-57ee-4d09-a074-2a379d73789e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] Acquiring lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] Acquired lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG nova.network.neutron [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing network info cache for port e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG nova.network.neutron [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully updated port: 1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG nova.network.neutron [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ad789df5-783c-44fb-a4cb-28e2ff668a6b req-863a1ef5-73da-4316-ba30-d7669f5a1215 service nova] Releasing lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: INFO nova.virt.block_device [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Booting with volume 0e40e127-3c2b-403a-be7e-7740290e26ae at /dev/vdb
Aug 17 08:20:05 user nova-compute[72998]: INFO nova.virt.block_device [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Booting with volume 4599d0ce-243a-45b2-97d6-b98d62908bab at /dev/vdc
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.utils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28ee8a7-4931-4ff7-ac85-f0b6a2579512]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.720s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.utils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.100s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ab6d91-cb4d-4c45-a13b-495866ad4573]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c48b2e-4572-4c2b-bf99-bb4f438e8857]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.091s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef36c688-16ac-4511-aa74-5c68fa24d8a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.093s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[927f6d82-f13e-418d-ace7-46410e448408]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaeefe6-54d0-4c4c-8b36-3c380b3eb21d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[30915f5d-5755-49fe-8253-64c775b0193d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[789e6cec-ff56-442a-8dd8-81809fe58367]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:20:05 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[526b18e9-89e6-4ec3-bc71-77b1c4fe54f4]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.utils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] <== get_connector_properties: return (412ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating existing volume attachment record: 2b41f1d9-eb03-4027-98fc-505063703ab4 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:20:05 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[af61b339-7182-4eeb-92b1-78ab016fccb1]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG os_brick.utils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] <== get_connector_properties: return (327ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:05 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating existing volume attachment record: d37e2f44-4b93-4e97-bdd7-d0f3e338022a {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-d5e9dea5-9cc8-4900-a702-447db82be4f3 req-c04042de-689e-4079-a64e-312d500f5a69 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-changed-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-d5e9dea5-9cc8-4900-a702-447db82be4f3 req-c04042de-689e-4079-a64e-312d500f5a69 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Refreshing instance network info cache due to event network-changed-1177fb3c-1f8f-489c-ada6-748478daa64b. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d5e9dea5-9cc8-4900-a702-447db82be4f3 req-c04042de-689e-4079-a64e-312d500f5a69 service nova] Acquiring lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d5e9dea5-9cc8-4900-a702-447db82be4f3 req-c04042de-689e-4079-a64e-312d500f5a69 service nova] Acquired lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-d5e9dea5-9cc8-4900-a702-447db82be4f3 req-c04042de-689e-4079-a64e-312d500f5a69 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Refreshing network info cache for port 1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully updated port: ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-changed-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing instance network info cache due to event network-changed-1b95d72a-55c1-4b66-8a9d-66c093e4c77a. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] Acquiring lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] Acquired lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing network info cache for port 1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-d5e9dea5-9cc8-4900-a702-447db82be4f3 req-c04042de-689e-4079-a64e-312d500f5a69 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updated VIF entry in instance network info cache for port 1177fb3c-1f8f-489c-ada6-748478daa64b. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-d5e9dea5-9cc8-4900-a702-447db82be4f3 req-c04042de-689e-4079-a64e-312d500f5a69 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating instance_info_cache with network_info: [{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d5e9dea5-9cc8-4900-a702-447db82be4f3 req-c04042de-689e-4079-a64e-312d500f5a69 service nova] Releasing lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] Releasing lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-changed-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing instance network info cache due to event network-changed-ba954fc7-e9d4-42b5-b321-cd7269e42fb4. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] Acquiring lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] Acquired lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing network info cache for port ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG nova.network.neutron [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d8151464-f377-498e-aaeb-0411fb8d9d26 req-5c23fef9-c437-4803-83a1-35b89e976f91 service nova] Releasing lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully updated port: 0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-df515fa8-3447-4d9c-9a29-f7db481077d1 req-6f15349b-40e2-4c0b-8396-d77eb785eb41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-changed-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-df515fa8-3447-4d9c-9a29-f7db481077d1 req-6f15349b-40e2-4c0b-8396-d77eb785eb41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing instance network info cache due to event network-changed-0d4a0aba-073f-4cc5-9314-46f5e0b0468a. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-df515fa8-3447-4d9c-9a29-f7db481077d1 req-6f15349b-40e2-4c0b-8396-d77eb785eb41 service nova] Acquiring lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-df515fa8-3447-4d9c-9a29-f7db481077d1 req-6f15349b-40e2-4c0b-8396-d77eb785eb41 service nova] Acquired lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-df515fa8-3447-4d9c-9a29-f7db481077d1 req-6f15349b-40e2-4c0b-8396-d77eb785eb41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing network info cache for port 0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-df515fa8-3447-4d9c-9a29-f7db481077d1 req-6f15349b-40e2-4c0b-8396-d77eb785eb41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Successfully updated port: af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-df515fa8-3447-4d9c-9a29-f7db481077d1 req-6f15349b-40e2-4c0b-8396-d77eb785eb41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-df515fa8-3447-4d9c-9a29-f7db481077d1 req-6f15349b-40e2-4c0b-8396-d77eb785eb41 service nova] Releasing lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquired lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:20:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:09 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:20:09 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7702MB free_disk=24.456298828125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cfbd3131-e61b-45a4-8c69-91081320f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 794e686e-2e6a-42f5-b817-5d18d2ad705e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance f79a3323-477f-4689-b8e3-35f2ff59a641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 70d270c8-e0fc-4b40-a2c9-95dd23316853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0c76033f-1eb7-4581-9e08-d262b4409c04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 24f6cff0-793a-48ae-bd48-b276e9580897 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 08:20:09 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-8091deca-67bf-4664-96e8-8e829d3ecb37 req-83248338-4ba0-4e31-a48c-3d414799bada service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-changed-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-8091deca-67bf-4664-96e8-8e829d3ecb37 req-83248338-4ba0-4e31-a48c-3d414799bada service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing instance network info cache due to event network-changed-af095d56-0fdd-44aa-bbd7-8dbc65a39804. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8091deca-67bf-4664-96e8-8e829d3ecb37 req-83248338-4ba0-4e31-a48c-3d414799bada service nova] Acquiring lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.978s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 08:20:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [{"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Releasing lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance network_info: |[{"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:20:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8091deca-67bf-4664-96e8-8e829d3ecb37 req-83248338-4ba0-4e31-a48c-3d414799bada service nova] Acquired lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:11 user nova-compute[72998]: DEBUG nova.network.neutron [req-8091deca-67bf-4664-96e8-8e829d3ecb37 req-83248338-4ba0-4e31-a48c-3d414799bada service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing network info cache for port af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:12 user nova-compute[72998]: DEBUG nova.network.neutron [req-8091deca-67bf-4664-96e8-8e829d3ecb37 req-83248338-4ba0-4e31-a48c-3d414799bada service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updated VIF entry in instance network info cache for port af095d56-0fdd-44aa-bbd7-8dbc65a39804. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:20:12 user nova-compute[72998]: DEBUG nova.network.neutron [req-8091deca-67bf-4664-96e8-8e829d3ecb37 req-83248338-4ba0-4e31-a48c-3d414799bada service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [{"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8091deca-67bf-4664-96e8-8e829d3ecb37 req-83248338-4ba0-4e31-a48c-3d414799bada service nova] Releasing lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:16 user nova-compute[72998]: INFO nova.compute.manager [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Terminating instance
Aug 17 08:20:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-4a65ca1a-ab6e-4e30-b336-929b67821c48 req-d0e5fa23-adbf-490e-afb0-074dfbfa0e17 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-unplugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4a65ca1a-ab6e-4e30-b336-929b67821c48 req-d0e5fa23-adbf-490e-afb0-074dfbfa0e17 service nova] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4a65ca1a-ab6e-4e30-b336-929b67821c48 req-d0e5fa23-adbf-490e-afb0-074dfbfa0e17 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4a65ca1a-ab6e-4e30-b336-929b67821c48 req-d0e5fa23-adbf-490e-afb0-074dfbfa0e17 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-4a65ca1a-ab6e-4e30-b336-929b67821c48 req-d0e5fa23-adbf-490e-afb0-074dfbfa0e17 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] No waiting events found dispatching network-vif-unplugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-4a65ca1a-ab6e-4e30-b336-929b67821c48 req-d0e5fa23-adbf-490e-afb0-074dfbfa0e17 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-unplugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:20:16 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Creating image(s)
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260402.031383, f79a3323-477f-4689-b8e3-35f2ff59a641 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:17 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] VM Stopped (Lifecycle Event)
Aug 17 08:20:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-10ee1d39-62e5-4791-b900-51e47cec5642 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.298s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Instance destroyed successfully.
Aug 17 08:20:17 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lazy-loading 'resources' on Instance uuid 70d270c8-e0fc-4b40-a2c9-95dd23316853 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1446432849',display_name='tempest-VolumesAdminNegativeTest-server-1446432849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1446432849',id=14,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:18:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b23b971dd054295802333297815ee12',ramdisk_id='',reservation_id='r-1vs60rzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1447835405',owner_user_name='tempest-VolumesAdminNegativeTest-1447835405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:18:12Z,user_data=None,user_id='e444ed21ebed454cb5c30943a5725f6b',uuid=70d270c8-e0fc-4b40-a2c9-95dd23316853,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converting VIF {"id": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "address": "fa:16:3e:c4:09:79", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60922f27-88", "ovs_interfaceid": "60922f27-88e7-4168-8ffe-efdf5d7d0918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:09:79,bridge_name='br-int',has_traffic_filtering=True,id=60922f27-88e7-4168-8ffe-efdf5d7d0918,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60922f27-88') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG os_vif [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:09:79,bridge_name='br-int',has_traffic_filtering=True,id=60922f27-88e7-4168-8ffe-efdf5d7d0918,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60922f27-88') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60922f27-88, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:17 user nova-compute[72998]: INFO os_vif [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:09:79,bridge_name='br-int',has_traffic_filtering=True,id=60922f27-88e7-4168-8ffe-efdf5d7d0918,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60922f27-88')
Aug 17 08:20:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Deleting instance files /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853_del
Aug 17 08:20:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Deletion of /opt/stack/data/nova/instances/70d270c8-e0fc-4b40-a2c9-95dd23316853_del complete
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.287s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk 1073741824" returned: 0 in 0.064s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:17 user nova-compute[72998]: INFO nova.compute.manager [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.333s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:20:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Cannot resize image /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Ensure instance console log exists: /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Start _get_guest_xml network_info=[{"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3e30f354-53fa-4121-b7a1-b86a4d7ff573', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtRFOwAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f79a3323-477f-4689-b8e3-35f2ff59a641', 'attached_at': '', 'detached_at': '', 'volume_id': 'c86f548e-92a7-4a7c-ac4e-fa659c203ad3', 'serial': 'c86f548e-92a7-4a7c-ac4e-fa659c203ad3'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:20:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 08:20:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'vcpu_model' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtRFOwAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:18 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:18 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:18 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0873eda-705e-4a72-870f-a0735e6d574f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:20:18 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[53de1790-8cc1-4378-a3c2-c17dec08be16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3] added
Aug 17 08:20:18 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a56a6-8013-442c-9571-4fac75ad8610]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae156533-336c-45c3-bd52-40f2c4c7b8c3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtRFOwAE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: INFO nova.virt.block_device [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Booting with volume 951757d9-dcef-4db4-9b14-1536137ada76 at /dev/vdc
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtRFOwAE" returned: 0 in 0.098s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a4fcc9-9501-41cc-a6c2-5152cb8c6195]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VtRFOwAE'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb6a919-0a85-4d6c-bf2b-08bfef02717d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dc4988-1ae4-401f-b2e9-6b0eaabe6c84]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:20:18 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:20:18 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:18 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:20:18 user nova-compute[72998]: : NotImplementedError
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.utils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72a5de8-b1ac-4086-95da-c55fde80c86a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb483e-917c-46ff-b549-f0d11705126f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260]
Aug 17 08:20:18 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260] successful.
Aug 17 08:20:18 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.034s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a78e9-aa9a-4599-ad97-1e8ff641c2d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.081s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e263f417-eae7-4e3c-a8f1-4ab10fa3b9b6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.compute.manager [req-aed095b1-e415-481a-82a8-4b7b11f10b20 req-f5916354-5e5d-447c-91c9-f2995354dc7b service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-deleted-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:18 user nova-compute[72998]: INFO nova.compute.manager [req-aed095b1-e415-481a-82a8-4b7b11f10b20 req-f5916354-5e5d-447c-91c9-f2995354dc7b service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Neutron deleted interface 60922f27-88e7-4168-8ffe-efdf5d7d0918; detaching it from the instance and deleting it from the info cache
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-aed095b1-e415-481a-82a8-4b7b11f10b20 req-f5916354-5e5d-447c-91c9-f2995354dc7b service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e852ac7e-974b-4f4a-adb0-43fab0f340aa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.058s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b7f172-6fc1-4cc0-9a5e-da6cddb55622]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:18 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:18 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.538s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:20:18 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Creating image(s)
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Ensure instance console log exists: /opt/stack/data/nova/instances/0c76033f-1eb7-4581-9e08-d262b4409c04/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Start _get_guest_xml network_info=[{"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c225b873-dc3e-40dd-b85f-29987f40e52b', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybStKMXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c76033f-1eb7-4581-9e08-d262b4409c04', 'attached_at': '', 'detached_at': '', 'volume_id': '3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982', 'serial': '3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'ac52f977-3ae8-4cf3-a90c-ab9a63c1c9b8', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'feSqyVRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c76033f-1eb7-4581-9e08-d262b4409c04', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7033c41-a077-4de9-ab33-2544a6199b2e', 'serial': 'f7033c41-a077-4de9-ab33-2544a6199b2e'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'd37e2f44-4b93-4e97-bdd7-d0f3e338022a', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwlpCxGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c76033f-1eb7-4581-9e08-d262b4409c04', 'attached_at': '', 'detached_at': '', 'volume_id': '4599d0ce-243a-45b2-97d6-b98d62908bab', 'serial': '4599d0ce-243a-45b2-97d6-b98d62908bab'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[37996370-0e4f-48cb-af90-05c49faf6a08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c034f2c1-7b0c-443d-bd9e-50d15af6bd44]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Took 1.26 seconds to deallocate network for instance.
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtRFOwAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.compute.manager [req-aed095b1-e415-481a-82a8-4b7b11f10b20 req-f5916354-5e5d-447c-91c9-f2995354dc7b service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Detach interface failed, port_id=60922f27-88e7-4168-8ffe-efdf5d7d0918, reason: Instance 70d270c8-e0fc-4b40-a2c9-95dd23316853 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:20:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:20:18 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:20:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b89d511-3a3f-4ee5-a6a6-b24f4300ea99]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG os_brick.utils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] <== get_connector_properties: return (332ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:18 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating existing volume attachment record: 896c23fd-71a8-4c51-9738-187aff352ad6 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] No waiting events found dispatching network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:19 user nova-compute[72998]: WARNING nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received unexpected event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 for instance with vm_state active and task_state deleting.
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] No waiting events found dispatching network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:19 user nova-compute[72998]: WARNING nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received unexpected event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 for instance with vm_state active and task_state deleting.
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] No waiting events found dispatching network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:19 user nova-compute[72998]: WARNING nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received unexpected event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 for instance with vm_state active and task_state deleting.
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-unplugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] No waiting events found dispatching network-vif-unplugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-unplugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Acquiring lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] No waiting events found dispatching network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:19 user nova-compute[72998]: WARNING nova.compute.manager [req-5a3192a0-a55a-478a-ac07-65992eee77b1 req-38640b20-ea36-4c06-a302-5826767f8337 service nova] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Received unexpected event network-vif-plugged-60922f27-88e7-4168-8ffe-efdf5d7d0918 for instance with vm_state active and task_state deleting.
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybStKMXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:19 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:19 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Deleted allocations for instance 70d270c8-e0fc-4b40-a2c9-95dd23316853
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a4d330c8-f22b-40d8-8167-62f6c6b0f569 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "70d270c8-e0fc-4b40-a2c9-95dd23316853" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.420s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.643s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== connect_volume: return (1645ms) {'type': 'block', 'scsi_wwn': '23833383734343136', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833383734343136', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.851s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:19 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:19 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5231b873-1070-4b2c-badc-3e65a4fba4c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:20:19 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-649770025',display_name='tempest-ServerActionsTestOtherA-server-21228523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-649770025',id=13,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkgz6KIvkjo7YISoQuK0gKb5worGqa3M96YDdoFGvE2t+BrFcgavSDbwPCbWbcUEBpB4d8lGQtJpxdLC26DtEQzWbxv/vhiZjqnt3G/kF8kNKY2c+leCXryY3xsQnrvtA==',key_name='tempest-keypair-1697256322',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-lz1l9ivg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=f79a3323-477f-4689-b8e3-35f2ff59a641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:20:19 user nova-compute[72998]:   <uuid>f79a3323-477f-4689-b8e3-35f2ff59a641</uuid>
Aug 17 08:20:19 user nova-compute[72998]:   <name>instance-0000000d</name>
Aug 17 08:20:19 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:20:19 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:20:19 user nova-compute[72998]:   <metadata>
Aug 17 08:20:19 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:20:19 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:20:19 user nova-compute[72998]:       <nova:name>tempest-ServerActionsTestOtherA-server-21228523</nova:name>
Aug 17 08:20:19 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:20:18</nova:creationTime>
Aug 17 08:20:19 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:20:19 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:20:19 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:20:19 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:20:19 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:20:19 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:20:19 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:20:19 user nova-compute[72998]:       <nova:owner>
Aug 17 08:20:19 user nova-compute[72998]:         <nova:user uuid="0be579ee85cb4ac2b59812bbee48c272">tempest-ServerActionsTestOtherA-1892042619-project-member</nova:user>
Aug 17 08:20:19 user nova-compute[72998]:         <nova:project uuid="d62167eb6909402f8dca89678acff055">tempest-ServerActionsTestOtherA-1892042619</nova:project>
Aug 17 08:20:19 user nova-compute[72998]:       </nova:owner>
Aug 17 08:20:19 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:20:19 user nova-compute[72998]:       <nova:ports>
Aug 17 08:20:19 user nova-compute[72998]:         <nova:port uuid="8cbeff07-8a68-46c9-92b4-58f4f07fb208">
Aug 17 08:20:19 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:20:19 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:19 user nova-compute[72998]:       </nova:ports>
Aug 17 08:20:19 user nova-compute[72998]:     </nova:instance>
Aug 17 08:20:19 user nova-compute[72998]:   </metadata>
Aug 17 08:20:19 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:20:19 user nova-compute[72998]:     <system>
Aug 17 08:20:19 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:20:19 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:20:19 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:20:19 user nova-compute[72998]:       <entry name="serial">f79a3323-477f-4689-b8e3-35f2ff59a641</entry>
Aug 17 08:20:19 user nova-compute[72998]:       <entry name="uuid">f79a3323-477f-4689-b8e3-35f2ff59a641</entry>
Aug 17 08:20:19 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:20:19 user nova-compute[72998]:     </system>
Aug 17 08:20:19 user nova-compute[72998]:   </sysinfo>
Aug 17 08:20:19 user nova-compute[72998]:   <os>
Aug 17 08:20:19 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:20:19 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:20:19 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:20:19 user nova-compute[72998]:   </os>
Aug 17 08:20:19 user nova-compute[72998]:   <features>
Aug 17 08:20:19 user nova-compute[72998]:     <acpi/>
Aug 17 08:20:19 user nova-compute[72998]:     <apic/>
Aug 17 08:20:19 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:20:19 user nova-compute[72998]:   </features>
Aug 17 08:20:19 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:20:19 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:20:19 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:20:19 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:20:19 user nova-compute[72998]:   </clock>
Aug 17 08:20:19 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:20:19 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:20:19 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:20:19 user nova-compute[72998]:   </cpu>
Aug 17 08:20:19 user nova-compute[72998]:   <devices>
Aug 17 08:20:19 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:20:19 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:20:19 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk"/>
Aug 17 08:20:19 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:20:19 user nova-compute[72998]:     </disk>
Aug 17 08:20:19 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:20:19 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:20:19 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 08:20:19 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:20:19 user nova-compute[72998]:       <serial>c86f548e-92a7-4a7c-ac4e-fa659c203ad3</serial>
Aug 17 08:20:19 user nova-compute[72998]:     </disk>
Aug 17 08:20:19 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:19 user nova-compute[72998]:       <mac address="fa:16:3e:aa:80:db"/>
Aug 17 08:20:19 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:19 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:19 user nova-compute[72998]:       <target dev="tap8cbeff07-8a"/>
Aug 17 08:20:19 user nova-compute[72998]:     </interface>
Aug 17 08:20:19 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:20:19 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/console.log" append="off"/>
Aug 17 08:20:19 user nova-compute[72998]:     </serial>
Aug 17 08:20:19 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:20:19 user nova-compute[72998]:     <video>
Aug 17 08:20:19 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:19 user nova-compute[72998]:     </video>
Aug 17 08:20:19 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:20:19 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:20:19 user nova-compute[72998]:     </rng>
Aug 17 08:20:19 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:20:19 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:20:19 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:20:19 user nova-compute[72998]:     </memballoon>
Aug 17 08:20:19 user nova-compute[72998]:   </devices>
Aug 17 08:20:19 user nova-compute[72998]: </domain>
Aug 17 08:20:19 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-649770025',display_name='tempest-ServerActionsTestOtherA-server-21228523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-649770025',id=13,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkgz6KIvkjo7YISoQuK0gKb5worGqa3M96YDdoFGvE2t+BrFcgavSDbwPCbWbcUEBpB4d8lGQtJpxdLC26DtEQzWbxv/vhiZjqnt3G/kF8kNKY2c+leCXryY3xsQnrvtA==',key_name='tempest-keypair-1697256322',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-lz1l9ivg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=f79a3323-477f-4689-b8e3-35f2ff59a641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG os_vif [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cbeff07-8a, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8cbeff07-8a, col_values=(('external_ids', {'iface-id': '8cbeff07-8a68-46c9-92b4-58f4f07fb208', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:80:db', 'vm-uuid': 'f79a3323-477f-4689-b8e3-35f2ff59a641'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a628e6d7-1ee6-47fb-93b7-3579d9245a30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982] added
Aug 17 08:20:20 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:20 user nova-compute[72998]: INFO os_vif [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a')
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d6699-c668-47f1-a4b4-be21a5a922a9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f1f78-8b96-4a19-9d35-3a767ff53426]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybStKMXV {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No VIF found with MAC fa:16:3e:aa:80:db, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybStKMXV" returned: 0 in 0.034s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7130abd5-0da0-4dc5-9c20-e9f19037e33b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ybStKMXV'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd61a7f-18ea-467f-97f7-f60562c9aa32]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba887fc7-2979-4c6e-995a-53d4bd2bea99]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:20 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:20 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e60051-c3e6-48ad-9d51-41326d4a0d54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982, portal: 172.16.0.220,3260]
Aug 17 08:20:20 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982, portal: 172.16.0.220,3260] successful.
Aug 17 08:20:20 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c6f3f1-5a53-4db0-9b03-018c9d53ea3c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd560f93-72b2-45c8-88a9-95f237aaa578]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:20 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:20 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:20 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:20 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[583d8f63-8e50-41ec-abe5-0852fe9b6d44]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:20 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybStKMXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] <== connect_volume: return (2286ms) {'type': 'block', 'scsi_wwn': '23336616462643566', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336616462643566', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'feSqyVRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:21 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:21 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:21 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcdfcc2-ffc6-47f2-ba23-21933c447ccd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:20:21 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae5ee7c-5cdc-4f00-b470-07a900e0c335]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e] added
Aug 17 08:20:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2272a29a-30bf-4ea4-98d7-87abc62992e7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1d8693-fdee-487f-8048-e00dd386f919]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v feSqyVRU {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v feSqyVRU" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b55020-3c6f-4f33-b488-27e6c26b52de]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'feSqyVRU'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac350b9-2424-4b39-9855-1a4d66ac3429]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[24029243-917e-4dd3-940f-67cefa05a71d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:21 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:21 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b96ab6d-9451-49db-955a-cba08a5931a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e, portal: 172.16.0.220,3260]
Aug 17 08:20:21 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e, portal: 172.16.0.220,3260] successful.
Aug 17 08:20:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f965491e-915d-454e-9682-7611b1f0c6cf]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdd6ffb-ac64-46c5-ac19-bc294e19eed1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:21 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:21 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:21 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:21 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f9405d-0e78-48bf-ada0-9e7e1b5308b3]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'feSqyVRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-a5985c65-d836-4862-a141-50f0bc5edbde req-c014b701-c609-4795-8e5b-c5e5760dc00b service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a5985c65-d836-4862-a141-50f0bc5edbde req-c014b701-c609-4795-8e5b-c5e5760dc00b service nova] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a5985c65-d836-4862-a141-50f0bc5edbde req-c014b701-c609-4795-8e5b-c5e5760dc00b service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a5985c65-d836-4862-a141-50f0bc5edbde req-c014b701-c609-4795-8e5b-c5e5760dc00b service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-a5985c65-d836-4862-a141-50f0bc5edbde req-c014b701-c609-4795-8e5b-c5e5760dc00b service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] No waiting events found dispatching network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:22 user nova-compute[72998]: WARNING nova.compute.manager [req-a5985c65-d836-4862-a141-50f0bc5edbde req-c014b701-c609-4795-8e5b-c5e5760dc00b service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received unexpected event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 08:20:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26366613631623263', 'path': '/dev/sdd'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366613631623263', 'path': '/dev/sdd'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwlpCxGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:22 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:22 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:22 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ad5e05-d46e-44a6-9141-6c808f263d06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:20:22 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8cb2f3-4cd7-4ccc-9964-d4b93aa994d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab] added
Aug 17 08:20:22 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee9c38e-7ac5-4bf6-8836-95fd25b3629b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f026ae0-7194-454a-bc56-9473a11974b5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwlpCxGg {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwlpCxGg" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[948f6f11-cbc9-40ee-af5f-269a48c99739]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mwlpCxGg'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1d55af-bb3f-4713-b8b1-c6840c22b257]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8a6c8b-5ad0-49ec-a2bd-74a35bd10ff3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c20518-c4d3-4273-a520-111e89287060]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab, portal: 172.16.0.220,3260]
Aug 17 08:20:23 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab, portal: 172.16.0.220,3260] successful.
Aug 17 08:20:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca5e2c-7320-4c14-afbd-b5784da73bdd]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[63103202-66e3-47a4-b173-bb456ad48b4d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:23 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[138d46aa-af1f-4198-b7fd-cc741ccc336e]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwlpCxGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:23 user nova-compute[72998]: INFO nova.compute.manager [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Shelving
Aug 17 08:20:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance destroyed successfully.
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] No waiting events found dispatching network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:24 user nova-compute[72998]: WARNING nova.compute.manager [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received unexpected event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-unplugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] No waiting events found dispatching network-vif-unplugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:24 user nova-compute[72998]: WARNING nova.compute.manager [req-ae8db175-4008-4eab-9f0e-8950fd666b10 req-ef45462f-0b56-4b92-abd8-f80a296432d6 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received unexpected event network-vif-unplugged-1177fb3c-1f8f-489c-ada6-748478daa64b for instance with vm_state active and task_state shelving.
Aug 17 08:20:24 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Beginning cold snapshot process
Aug 17 08:20:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23434316430313831', 'path': '/dev/sde'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434316430313831', 'path': '/dev/sde'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:b7:bc,bridge_name='br-int',has_traffic_filtering=True,id=dfe13d48-2d8d-418b-bbd3-d2ee257689d6,network=Network(ad0bf549-4cf4-4a6d-833e-bf8c51c8c615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe13d48-2d') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb3401d-f2') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=b1002575-29c6-47ba-b59a-f56301313413,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1002575-29') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:9c,bridge_name='br-int',has_traffic_filtering=True,id=2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0c4dd2-d7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=ce6e7ec2-63bb-4fbb-9fbc-192e33b70022,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6e7ec2-63') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:99:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4bb88-f3') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:1a,bridge_name='br-int',has_traffic_filtering=True,id=735cd582-44ee-4a10-ab3d-529677296802,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735cd582-44') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c76033f-1eb7-4581-9e08-d262b4409c04 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:20:24 user nova-compute[72998]:   <uuid>0c76033f-1eb7-4581-9e08-d262b4409c04</uuid>
Aug 17 08:20:24 user nova-compute[72998]:   <name>instance-00000010</name>
Aug 17 08:20:24 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:20:24 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:20:24 user nova-compute[72998]:   <metadata>
Aug 17 08:20:24 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:20:24 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:20:24 user nova-compute[72998]:       <nova:name>tempest-device-tagging-server-1848862296</nova:name>
Aug 17 08:20:24 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:20:18</nova:creationTime>
Aug 17 08:20:24 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:20:24 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:20:24 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:20:24 user nova-compute[72998]:       <nova:owner>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:user uuid="a5c3bceee1c54e19bad334ee473e4889">tempest-TaggedBootDevicesTest-848836101-project-member</nova:user>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:project uuid="e98f8721de96438582bae61d057d202b">tempest-TaggedBootDevicesTest-848836101</nova:project>
Aug 17 08:20:24 user nova-compute[72998]:       </nova:owner>
Aug 17 08:20:24 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:20:24 user nova-compute[72998]:       <nova:ports>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:port uuid="dfe13d48-2d8d-418b-bbd3-d2ee257689d6">
Aug 17 08:20:24 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 08:20:24 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:port uuid="2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205">
Aug 17 08:20:24 user nova-compute[72998]:           <nova:ip type="fixed" address="10.1.1.197" ipVersion="4"/>
Aug 17 08:20:24 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:port uuid="b1002575-29c6-47ba-b59a-f56301313413">
Aug 17 08:20:24 user nova-compute[72998]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Aug 17 08:20:24 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:port uuid="2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c">
Aug 17 08:20:24 user nova-compute[72998]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Aug 17 08:20:24 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:port uuid="ce6e7ec2-63bb-4fbb-9fbc-192e33b70022">
Aug 17 08:20:24 user nova-compute[72998]:           <nova:ip type="fixed" address="10.1.1.51" ipVersion="4"/>
Aug 17 08:20:24 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:port uuid="7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2">
Aug 17 08:20:24 user nova-compute[72998]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 08:20:24 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:24 user nova-compute[72998]:         <nova:port uuid="735cd582-44ee-4a10-ab3d-529677296802">
Aug 17 08:20:24 user nova-compute[72998]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 08:20:24 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:24 user nova-compute[72998]:       </nova:ports>
Aug 17 08:20:24 user nova-compute[72998]:     </nova:instance>
Aug 17 08:20:24 user nova-compute[72998]:   </metadata>
Aug 17 08:20:24 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:20:24 user nova-compute[72998]:     <system>
Aug 17 08:20:24 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:20:24 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:20:24 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:20:24 user nova-compute[72998]:       <entry name="serial">0c76033f-1eb7-4581-9e08-d262b4409c04</entry>
Aug 17 08:20:24 user nova-compute[72998]:       <entry name="uuid">0c76033f-1eb7-4581-9e08-d262b4409c04</entry>
Aug 17 08:20:24 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:20:24 user nova-compute[72998]:     </system>
Aug 17 08:20:24 user nova-compute[72998]:   </sysinfo>
Aug 17 08:20:24 user nova-compute[72998]:   <os>
Aug 17 08:20:24 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:20:24 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:20:24 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:20:24 user nova-compute[72998]:   </os>
Aug 17 08:20:24 user nova-compute[72998]:   <features>
Aug 17 08:20:24 user nova-compute[72998]:     <acpi/>
Aug 17 08:20:24 user nova-compute[72998]:     <apic/>
Aug 17 08:20:24 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:20:24 user nova-compute[72998]:   </features>
Aug 17 08:20:24 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:20:24 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:20:24 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:20:24 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:20:24 user nova-compute[72998]:   </clock>
Aug 17 08:20:24 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:20:24 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:20:24 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:20:24 user nova-compute[72998]:   </cpu>
Aug 17 08:20:24 user nova-compute[72998]:   <devices>
Aug 17 08:20:24 user nova-compute[72998]:     <disk type="file" device="cdrom">
Aug 17 08:20:24 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 08:20:24 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/0c76033f-1eb7-4581-9e08-d262b4409c04/disk.config"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="hda" bus="ide"/>
Aug 17 08:20:24 user nova-compute[72998]:     </disk>
Aug 17 08:20:24 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:20:24 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:20:24 user nova-compute[72998]:       <source dev="/dev/sdc"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <serial>3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982</serial>
Aug 17 08:20:24 user nova-compute[72998]:     </disk>
Aug 17 08:20:24 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:20:24 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:20:24 user nova-compute[72998]:       <source dev="/dev/sdd"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <serial>f7033c41-a077-4de9-ab33-2544a6199b2e</serial>
Aug 17 08:20:24 user nova-compute[72998]:     </disk>
Aug 17 08:20:24 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:20:24 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:20:24 user nova-compute[72998]:       <source dev="/dev/sde"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="vdc" bus="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <serial>4599d0ce-243a-45b2-97d6-b98d62908bab</serial>
Aug 17 08:20:24 user nova-compute[72998]:     </disk>
Aug 17 08:20:24 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:24 user nova-compute[72998]:       <mac address="fa:16:3e:41:b7:bc"/>
Aug 17 08:20:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="tapdfe13d48-2d"/>
Aug 17 08:20:24 user nova-compute[72998]:     </interface>
Aug 17 08:20:24 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:24 user nova-compute[72998]:       <mac address="fa:16:3e:04:8b:5c"/>
Aug 17 08:20:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="tap2eb3401d-f2"/>
Aug 17 08:20:24 user nova-compute[72998]:     </interface>
Aug 17 08:20:24 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:24 user nova-compute[72998]:       <mac address="fa:16:3e:5b:2b:99"/>
Aug 17 08:20:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="tapb1002575-29"/>
Aug 17 08:20:24 user nova-compute[72998]:     </interface>
Aug 17 08:20:24 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:24 user nova-compute[72998]:       <mac address="fa:16:3e:fb:56:9c"/>
Aug 17 08:20:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="tap2f0c4dd2-d7"/>
Aug 17 08:20:24 user nova-compute[72998]:     </interface>
Aug 17 08:20:24 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:24 user nova-compute[72998]:       <mac address="fa:16:3e:10:cd:70"/>
Aug 17 08:20:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="tapce6e7ec2-63"/>
Aug 17 08:20:24 user nova-compute[72998]:     </interface>
Aug 17 08:20:24 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:24 user nova-compute[72998]:       <mac address="fa:16:3e:3a:99:ef"/>
Aug 17 08:20:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="tap7ba4bb88-f3"/>
Aug 17 08:20:24 user nova-compute[72998]:     </interface>
Aug 17 08:20:24 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:24 user nova-compute[72998]:       <mac address="fa:16:3e:e1:a6:1a"/>
Aug 17 08:20:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:24 user nova-compute[72998]:       <target dev="tap735cd582-44"/>
Aug 17 08:20:24 user nova-compute[72998]:     </interface>
Aug 17 08:20:24 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:20:24 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/0c76033f-1eb7-4581-9e08-d262b4409c04/console.log" append="off"/>
Aug 17 08:20:24 user nova-compute[72998]:     </serial>
Aug 17 08:20:24 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:20:24 user nova-compute[72998]:     <video>
Aug 17 08:20:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:24 user nova-compute[72998]:     </video>
Aug 17 08:20:24 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:20:24 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:20:24 user nova-compute[72998]:     </rng>
Aug 17 08:20:24 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:20:24 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:20:24 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:20:24 user nova-compute[72998]:     </memballoon>
Aug 17 08:20:24 user nova-compute[72998]:   </devices>
Aug 17 08:20:24 user nova-compute[72998]: </domain>
Aug 17 08:20:24 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:b7:bc,bridge_name='br-int',has_traffic_filtering=True,id=dfe13d48-2d8d-418b-bbd3-d2ee257689d6,network=Network(ad0bf549-4cf4-4a6d-833e-bf8c51c8c615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe13d48-2d') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:b7:bc,bridge_name='br-int',has_traffic_filtering=True,id=dfe13d48-2d8d-418b-bbd3-d2ee257689d6,network=Network(ad0bf549-4cf4-4a6d-833e-bf8c51c8c615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe13d48-2d') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfe13d48-2d, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfe13d48-2d, col_values=(('external_ids', {'iface-id': 'dfe13d48-2d8d-418b-bbd3-d2ee257689d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:b7:bc', 'vm-uuid': '0c76033f-1eb7-4581-9e08-d262b4409c04'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260424.341699, f79a3323-477f-4689-b8e3-35f2ff59a641 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:24 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] VM Resumed (Lifecycle Event)
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:20:24 user nova-compute[72998]: INFO os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:b7:bc,bridge_name='br-int',has_traffic_filtering=True,id=dfe13d48-2d8d-418b-bbd3-d2ee257689d6,network=Network(ad0bf549-4cf4-4a6d-833e-bf8c51c8c615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe13d48-2d')
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb3401d-f2') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb3401d-f2') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eb3401d-f2, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eb3401d-f2, col_values=(('external_ids', {'iface-id': '2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:8b:5c', 'vm-uuid': '0c76033f-1eb7-4581-9e08-d262b4409c04'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:24 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Instance spawned successfully.
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: INFO os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb3401d-f2')
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=b1002575-29c6-47ba-b59a-f56301313413,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1002575-29') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=b1002575-29c6-47ba-b59a-f56301313413,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1002575-29') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1002575-29, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1002575-29, col_values=(('external_ids', {'iface-id': 'b1002575-29c6-47ba-b59a-f56301313413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:2b:99', 'vm-uuid': '0c76033f-1eb7-4581-9e08-d262b4409c04'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:24 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260424.3420508, f79a3323-477f-4689-b8e3-35f2ff59a641 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:24 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] VM Started (Lifecycle Event)
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk /opt/stack/data/nova/instances/snapshots/tmpxy4m3nnd/79515edc32a3420ab5901fc3508330d2 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:24 user nova-compute[72998]: INFO os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=b1002575-29c6-47ba-b59a-f56301313413,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1002575-29')
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:9c,bridge_name='br-int',has_traffic_filtering=True,id=2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0c4dd2-d7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:9c,bridge_name='br-int',has_traffic_filtering=True,id=2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0c4dd2-d7') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f0c4dd2-d7, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f0c4dd2-d7, col_values=(('external_ids', {'iface-id': '2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:56:9c', 'vm-uuid': '0c76033f-1eb7-4581-9e08-d262b4409c04'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:24 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: INFO os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:9c,bridge_name='br-int',has_traffic_filtering=True,id=2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0c4dd2-d7')
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=ce6e7ec2-63bb-4fbb-9fbc-192e33b70022,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6e7ec2-63') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=ce6e7ec2-63bb-4fbb-9fbc-192e33b70022,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6e7ec2-63') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce6e7ec2-63, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce6e7ec2-63, col_values=(('external_ids', {'iface-id': 'ce6e7ec2-63bb-4fbb-9fbc-192e33b70022', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:cd:70', 'vm-uuid': '0c76033f-1eb7-4581-9e08-d262b4409c04'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: INFO os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=ce6e7ec2-63bb-4fbb-9fbc-192e33b70022,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6e7ec2-63')
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:99:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4bb88-f3') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:99:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4bb88-f3') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72998) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ba4bb88-f3, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ba4bb88-f3, col_values=(('external_ids', {'iface-id': '7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:99:ef', 'vm-uuid': '0c76033f-1eb7-4581-9e08-d262b4409c04'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: INFO os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:99:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4bb88-f3')
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:1a,bridge_name='br-int',has_traffic_filtering=True,id=735cd582-44ee-4a10-ab3d-529677296802,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735cd582-44') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:1a,bridge_name='br-int',has_traffic_filtering=True,id=735cd582-44ee-4a10-ab3d-529677296802,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735cd582-44') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fe5a38da-9d1c-413c-b825-66d50643e200 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.151s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap735cd582-44, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap735cd582-44, col_values=(('external_ids', {'iface-id': '735cd582-44ee-4a10-ab3d-529677296802', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:a6:1a', 'vm-uuid': '0c76033f-1eb7-4581-9e08-d262b4409c04'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:25 user nova-compute[72998]: INFO os_vif [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:1a,bridge_name='br-int',has_traffic_filtering=True,id=735cd582-44ee-4a10-ab3d-529677296802,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735cd582-44')
Aug 17 08:20:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] No BDM found with device name hda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:20:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:20:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] No VIF found with MAC fa:16:3e:41:b7:bc, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:20:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] No VIF found with MAC fa:16:3e:10:cd:70, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:20:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Using config drive
Aug 17 08:20:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk /opt/stack/data/nova/instances/snapshots/tmpxy4m3nnd/79515edc32a3420ab5901fc3508330d2" returned: 0 in 0.825s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Snapshot extracted, beginning image upload
Aug 17 08:20:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Creating config drive at /opt/stack/data/nova/instances/0c76033f-1eb7-4581-9e08-d262b4409c04/disk.config
Aug 17 08:20:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c76033f-1eb7-4581-9e08-d262b4409c04/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp441trhfn {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c76033f-1eb7-4581-9e08-d262b4409c04/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp441trhfn" returned: 0 in 0.092s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-1ad11e04-507c-4853-93f3-ed6c6a6ed291 req-b411fdb0-2a51-4843-950f-f25fda00c50c service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1ad11e04-507c-4853-93f3-ed6c6a6ed291 req-b411fdb0-2a51-4843-950f-f25fda00c50c service nova] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1ad11e04-507c-4853-93f3-ed6c6a6ed291 req-b411fdb0-2a51-4843-950f-f25fda00c50c service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1ad11e04-507c-4853-93f3-ed6c6a6ed291 req-b411fdb0-2a51-4843-950f-f25fda00c50c service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-1ad11e04-507c-4853-93f3-ed6c6a6ed291 req-b411fdb0-2a51-4843-950f-f25fda00c50c service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] No waiting events found dispatching network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:26 user nova-compute[72998]: WARNING nova.compute.manager [req-1ad11e04-507c-4853-93f3-ed6c6a6ed291 req-b411fdb0-2a51-4843-950f-f25fda00c50c service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received unexpected event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-fbe5c60b-b5b8-4b69-9203-a54266bb4d91 req-86140a56-0ba7-4be5-9f96-c66946f07c4c service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fbe5c60b-b5b8-4b69-9203-a54266bb4d91 req-86140a56-0ba7-4be5-9f96-c66946f07c4c service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fbe5c60b-b5b8-4b69-9203-a54266bb4d91 req-86140a56-0ba7-4be5-9f96-c66946f07c4c service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fbe5c60b-b5b8-4b69-9203-a54266bb4d91 req-86140a56-0ba7-4be5-9f96-c66946f07c4c service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-fbe5c60b-b5b8-4b69-9203-a54266bb4d91 req-86140a56-0ba7-4be5-9f96-c66946f07c4c service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:27 user nova-compute[72998]: WARNING nova.compute.manager [req-fbe5c60b-b5b8-4b69-9203-a54266bb4d91 req-86140a56-0ba7-4be5-9f96-c66946f07c4c service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 for instance with vm_state building and task_state spawning.
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-c678c17f-aabf-4ef1-83c8-32e048b25994 req-937bf548-9a1d-4a61-8bcd-9797578f0cfd service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c678c17f-aabf-4ef1-83c8-32e048b25994 req-937bf548-9a1d-4a61-8bcd-9797578f0cfd service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c678c17f-aabf-4ef1-83c8-32e048b25994 req-937bf548-9a1d-4a61-8bcd-9797578f0cfd service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c678c17f-aabf-4ef1-83c8-32e048b25994 req-937bf548-9a1d-4a61-8bcd-9797578f0cfd service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-c678c17f-aabf-4ef1-83c8-32e048b25994 req-937bf548-9a1d-4a61-8bcd-9797578f0cfd service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:28 user nova-compute[72998]: WARNING nova.compute.manager [req-c678c17f-aabf-4ef1-83c8-32e048b25994 req-937bf548-9a1d-4a61-8bcd-9797578f0cfd service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 for instance with vm_state building and task_state spawning.
Aug 17 08:20:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Snapshot image upload complete
Aug 17 08:20:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:28 user nova-compute[72998]: INFO nova.compute.manager [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Shelve offloading
Aug 17 08:20:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance destroyed successfully.
Aug 17 08:20:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquired lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG nova.network.neutron [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:29 user nova-compute[72998]: WARNING nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 for instance with vm_state building and task_state spawning.
Aug 17 08:20:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:29 user nova-compute[72998]: WARNING nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-b1002575-29c6-47ba-b59a-f56301313413 for instance with vm_state building and task_state spawning.
Aug 17 08:20:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:29 user nova-compute[72998]: WARNING nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-b1002575-29c6-47ba-b59a-f56301313413 for instance with vm_state building and task_state spawning.
Aug 17 08:20:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:29 user nova-compute[72998]: WARNING nova.compute.manager [req-c177ba30-ae8b-440f-9d3d-d429f662f152 req-7f37ca7c-9c6c-4edd-813f-1e2b1002f6ee service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 for instance with vm_state building and task_state spawning.
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:30 user nova-compute[72998]: WARNING nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 for instance with vm_state building and task_state spawning.
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:30 user nova-compute[72998]: WARNING nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c for instance with vm_state building and task_state spawning.
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:30 user nova-compute[72998]: WARNING nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c for instance with vm_state building and task_state spawning.
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:30 user nova-compute[72998]: WARNING nova.compute.manager [req-63cf9f38-e590-492c-bc9a-9715abb957b0 req-ca7df9ae-9dab-4259-80fd-6ef07912f0d2 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-735cd582-44ee-4a10-ab3d-529677296802 for instance with vm_state building and task_state spawning.
Aug 17 08:20:30 user nova-compute[72998]: INFO nova.compute.manager [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] instance snapshotting
Aug 17 08:20:30 user nova-compute[72998]: DEBUG nova.network.neutron [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating instance_info_cache with network_info: [{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:30 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Beginning live snapshot process
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Releasing lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json -f qcow2 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json -f qcow2" returned: 0 in 0.259s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json -f qcow2 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json -f qcow2" returned: 0 in 0.253s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.304s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbadz_3ol/eca7799f16534022b54f27bc3ecb5d05.delta 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbadz_3ol/eca7799f16534022b54f27bc3ecb5d05.delta 1073741824" returned: 0 in 0.080s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:31 user nova-compute[72998]: WARNING nova.compute.manager [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 for instance with vm_state building and task_state spawning.
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:31 user nova-compute[72998]: WARNING nova.compute.manager [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 for instance with vm_state building and task_state spawning.
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:31 user nova-compute[72998]: WARNING nova.compute.manager [req-a4800315-503e-49f6-8408-87636086a201 req-33c5bda6-b667-4b43-85af-b538f8e21424 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 for instance with vm_state building and task_state spawning.
Aug 17 08:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance destroyed successfully.
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'resources' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1227355977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1227355977',id=15,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Ao/Go/8XDt42KXZYAz7AA6xYP7QW9nvLmuMDh5kL5LttNu902QcyLN6d7iY1AKVZtdM+xSQn+inyBY6PhC2wTcUIs19u3C4QCCleb9u11G3dMj8vS2CmA4ZNcVsXapw==',key_name='tempest-keypair-198637846',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:18:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-9031z9p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member',shelved_at='2023-08-17T08:20:28.798120',shelved_host='user',shelved_image_id='408413c7-90ba-4827-a322-8d3e6f4fd222'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG os_vif [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1177fb3c-1f, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:31 user nova-compute[72998]: INFO os_vif [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f')
Aug 17 08:20:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Deleting instance files /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66_del
Aug 17 08:20:32 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Deletion of /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66_del complete
Aug 17 08:20:32 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Deleted allocations for instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66
Aug 17 08:20:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.objects.instance [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260417.344066, 70d270c8-e0fc-4b40-a2c9-95dd23316853 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:32 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] VM Stopped (Lifecycle Event)
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-01b79725-898e-47bc-95b4-2ec477eda3b4 None None] [instance: 70d270c8-e0fc-4b40-a2c9-95dd23316853] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:32 user nova-compute[72998]: WARNING nova.compute.manager [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-735cd582-44ee-4a10-ab3d-529677296802 for instance with vm_state building and task_state spawning.
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-changed-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Refreshing instance network info cache due to event network-changed-1177fb3c-1f8f-489c-ada6-748478daa64b. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] Acquiring lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] Acquired lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.network.neutron [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Refreshing network info cache for port 1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260432.6253555, 0c76033f-1eb7-4581-9e08-d262b4409c04 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:32 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] VM Resumed (Lifecycle Event)
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:20:32 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance spawned successfully.
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:32 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260432.6269333, 0c76033f-1eb7-4581-9e08-d262b4409c04 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:32 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] VM Started (Lifecycle Event)
Aug 17 08:20:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.545s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:32 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:20:33 user nova-compute[72998]: INFO nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Took 14.19 seconds to spawn the instance on the hypervisor.
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-10f8928d-8722-4fd9-96ec-103aa72fde11 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.659s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] COPY block job progress, current cursor: 19922944 final cursor: 75563008 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:20:33 user nova-compute[72998]: INFO nova.compute.manager [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Took 53.63 seconds to build instance.
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3974d861-283f-4859-94ea-9ec32cfd9191 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.766s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.network.neutron [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updated VIF entry in instance network info cache for port 1177fb3c-1f8f-489c-ada6-748478daa64b. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.network.neutron [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating instance_info_cache with network_info: [{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bc86222c-ee26-45b8-90db-4d53da1d79c4 req-a8ffe04f-854c-47e4-83f4-ebfb450ceafc service nova] Releasing lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:33 user nova-compute[72998]: WARNING nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid e2b811f8-19a3-4b50-8ea9-6d3442c38819 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid cfbd3131-e61b-45a4-8c69-91081320f046 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 0c76033f-1eb7-4581-9e08-d262b4409c04 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 24f6cff0-793a-48ae-bd48-b276e9580897 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:33 user nova-compute[72998]: INFO nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] During sync_power_state the instance has a pending task (image_pending_upload). Skip.
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:20:33 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 08:20:33 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:20:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbadz_3ol/eca7799f16534022b54f27bc3ecb5d05.delta /opt/stack/data/nova/instances/snapshots/tmpbadz_3ol/eca7799f16534022b54f27bc3ecb5d05 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbadz_3ol/eca7799f16534022b54f27bc3ecb5d05.delta /opt/stack/data/nova/instances/snapshots/tmpbadz_3ol/eca7799f16534022b54f27bc3ecb5d05" returned: 0 in 0.864s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Snapshot extracted, beginning image upload
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:20:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Creating image(s)
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Ensure instance console log exists: /opt/stack/data/nova/instances/24f6cff0-793a-48ae-bd48-b276e9580897/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Start _get_guest_xml network_info=[{"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '32726db3-73bf-4375-bf2a-b9147f03d6b0', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsoPbBft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24f6cff0-793a-48ae-bd48-b276e9580897', 'attached_at': '', 'detached_at': '', 'volume_id': '3f91b5a5-ba2c-4844-851e-7f31b2b7d035', 'serial': '3f91b5a5-ba2c-4844-851e-7f31b2b7d035'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None}, {'attachment_id': '2b41f1d9-eb03-4027-98fc-505063703ab4', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFriHRNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24f6cff0-793a-48ae-bd48-b276e9580897', 'attached_at': '', 'detached_at': '', 'volume_id': '0e40e127-3c2b-403a-be7e-7740290e26ae', 'serial': '0e40e127-3c2b-403a-be7e-7740290e26ae'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None}, {'attachment_id': '896c23fd-71a8-4c51-9738-187aff352ad6', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RomTsrup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24f6cff0-793a-48ae-bd48-b276e9580897', 'attached_at': '', 'detached_at': '', 'volume_id': '951757d9-dcef-4db4-9b14-1536137ada76', 'serial': '951757d9-dcef-4db4-9b14-1536137ada76'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:20:34 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:20:34 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:20:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsoPbBft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:35 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:35 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:35 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4200c9-84bc-430f-98b2-4301c1944a1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:20:35 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d01238-270b-45b6-8b14-48cde341064a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035] added
Aug 17 08:20:35 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2def7d66-6939-41f5-a41e-fb1098da999c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2815611c-6515-49d4-847b-54c3d97e1540]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsoPbBft {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jsoPbBft" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f81033c-0dd0-4ecd-b842-994f5e625f45]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jsoPbBft'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3739eb9-9359-48df-959d-5891c06e8abd]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fc0641-2487-4514-93b7-934f19f0a871]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:35 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:35 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3c03d5-5217-4c57-a10a-348b0724b74a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035, portal: 172.16.0.220,3260]
Aug 17 08:20:35 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035, portal: 172.16.0.220,3260] successful.
Aug 17 08:20:35 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e9554c-620f-4bc5-a891-59df534139aa]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d1b57a-96ea-41af-ad7e-cb74de00a922]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:35 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:35 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c9557-da97-40fe-a60b-32b334301b35]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:20:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsoPbBft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26266333161333437', 'path': '/dev/sdf'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266333161333437', 'path': '/dev/sdf'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFriHRNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:36 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4b1d19-c239-44b1-9095-09b2577ae1f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:20:36 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb6434-4c8b-43cb-8230-1a14242289bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae] added
Aug 17 08:20:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d095c18d-8ecc-4ff7-9f5a-1cb3629d3289]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d269f244-8b79-4a39-8749-e2a467d88ef1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFriHRNW {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFriHRNW" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[53290ff2-4aee-4e2e-939e-0aaca3c3c568]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TFriHRNW'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7978b674-19fc-45cc-9844-bef8cbb1d717]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0d4d08-1854-4a68-88fa-a6bc4f9c0168]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1967dd-acb9-445c-980d-58092e8a3c46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae, portal: 172.16.0.220,3260]
Aug 17 08:20:36 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae, portal: 172.16.0.220,3260] successful.
Aug 17 08:20:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[441690a6-0a83-4c2d-ba63-ae7c01bf3034]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[49807119-78d8-4302-932e-adffeb46255f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:20:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:36 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:20:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ae406f-5786-4cb0-9d5c-9d9280f4fccd]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFriHRNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:20:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:37 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Snapshot image upload complete
Aug 17 08:20:37 user nova-compute[72998]: INFO nova.compute.manager [None req-a7f6b929-2911-4209-909e-2a80781dd6da tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Took 7.22 seconds to snapshot the instance on the hypervisor.
Aug 17 08:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26439353239653764', 'path': '/dev/sdg'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439353239653764', 'path': '/dev/sdg'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RomTsrup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:20:37 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:37 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:20:37 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37e22fa-82b7-470d-88ce-6a453f6d82ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:20:37 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ae5220-2662-4d86-a051-2034bc7b11f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76] added
Aug 17 08:20:38 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dfcd52-6e39-40a3-961e-a6fa2a1d106b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd2d6cb-cf73-45ea-9ad9-128d0fa41067]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RomTsrup {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RomTsrup" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedbea25-e29b-4cdd-bb1e-8ac7fd9d81c3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RomTsrup'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e391df-419f-47e0-8542-7776c31aaa4e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae20ec7-5f4b-4826-80a3-c26f607f5788]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:20:38 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:20:38 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcda6cb7-9058-4b9c-898a-a5e2dc91da0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76, portal: 172.16.0.220,3260]
Aug 17 08:20:38 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76, portal: 172.16.0.220,3260] successful.
Aug 17 08:20:38 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0a6ba8-50b6-46f6-bcf8-06abd8ee3320]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd9b32-f7e1-4dab-87b8-4c1f16d03b66]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:20:38 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:20:38 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bd1b58-2a6d-43b7-b093-c6dbed47ae1d]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:20:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RomTsrup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260424.0319984, 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:39 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] VM Stopped (Lifecycle Event)
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ed36cb2c-de9a-48ba-98dd-3c4b854259d6 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23163333030343534', 'path': '/dev/sdh'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163333030343534', 'path': '/dev/sdh'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:9f,bridge_name='br-int',has_traffic_filtering=True,id=f8f7f651-7001-4a2f-9a3f-845df27fb248,network=Network(8050f3d2-b71c-4064-888d-359e11222fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f7f651-70') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=45f6182c-0023-4956-b6c9-69cf1980698c,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f6182c-00') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=e7b6ef84-57ee-4d09-a074-2a379d73789e,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7b6ef84-57') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:36:a9,bridge_name='br-int',has_traffic_filtering=True,id=1b95d72a-55c1-4b66-8a9d-66c093e4c77a,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b95d72a-55') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ce:93,bridge_name='br-int',has_traffic_filtering=True,id=ba954fc7-e9d4-42b5-b321-cd7269e42fb4,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba954fc7-e9') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=0d4a0aba-073f-4cc5-9314-46f5e0b0468a,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4a0aba-07') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:98:17,bridge_name='br-int',has_traffic_filtering=True,id=af095d56-0fdd-44aa-bbd7-8dbc65a39804,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf095d56-0f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lazy-loading 'pci_devices' on Instance uuid 24f6cff0-793a-48ae-bd48-b276e9580897 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:20:39 user nova-compute[72998]:   <uuid>24f6cff0-793a-48ae-bd48-b276e9580897</uuid>
Aug 17 08:20:39 user nova-compute[72998]:   <name>instance-00000011</name>
Aug 17 08:20:39 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:20:39 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:20:39 user nova-compute[72998]:   <metadata>
Aug 17 08:20:39 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:20:39 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:20:39 user nova-compute[72998]:       <nova:name>tempest-device-tagging-server-1145594164</nova:name>
Aug 17 08:20:39 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:20:34</nova:creationTime>
Aug 17 08:20:39 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:20:39 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:20:39 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:20:39 user nova-compute[72998]:       <nova:owner>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:user uuid="d037e26859554af98bbe00502a606744">tempest-TaggedBootDevicesTest_v242-21992590-project-member</nova:user>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:project uuid="83124dfa96344a56b27b2f89eeda1976">tempest-TaggedBootDevicesTest_v242-21992590</nova:project>
Aug 17 08:20:39 user nova-compute[72998]:       </nova:owner>
Aug 17 08:20:39 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:20:39 user nova-compute[72998]:       <nova:ports>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:port uuid="f8f7f651-7001-4a2f-9a3f-845df27fb248">
Aug 17 08:20:39 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 08:20:39 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:port uuid="45f6182c-0023-4956-b6c9-69cf1980698c">
Aug 17 08:20:39 user nova-compute[72998]:           <nova:ip type="fixed" address="10.1.1.245" ipVersion="4"/>
Aug 17 08:20:39 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:port uuid="e7b6ef84-57ee-4d09-a074-2a379d73789e">
Aug 17 08:20:39 user nova-compute[72998]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
Aug 17 08:20:39 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:port uuid="1b95d72a-55c1-4b66-8a9d-66c093e4c77a">
Aug 17 08:20:39 user nova-compute[72998]:           <nova:ip type="fixed" address="10.1.1.104" ipVersion="4"/>
Aug 17 08:20:39 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:port uuid="ba954fc7-e9d4-42b5-b321-cd7269e42fb4">
Aug 17 08:20:39 user nova-compute[72998]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Aug 17 08:20:39 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:port uuid="0d4a0aba-073f-4cc5-9314-46f5e0b0468a">
Aug 17 08:20:39 user nova-compute[72998]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 08:20:39 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:39 user nova-compute[72998]:         <nova:port uuid="af095d56-0fdd-44aa-bbd7-8dbc65a39804">
Aug 17 08:20:39 user nova-compute[72998]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 08:20:39 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:39 user nova-compute[72998]:       </nova:ports>
Aug 17 08:20:39 user nova-compute[72998]:     </nova:instance>
Aug 17 08:20:39 user nova-compute[72998]:   </metadata>
Aug 17 08:20:39 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:20:39 user nova-compute[72998]:     <system>
Aug 17 08:20:39 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:20:39 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:20:39 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:20:39 user nova-compute[72998]:       <entry name="serial">24f6cff0-793a-48ae-bd48-b276e9580897</entry>
Aug 17 08:20:39 user nova-compute[72998]:       <entry name="uuid">24f6cff0-793a-48ae-bd48-b276e9580897</entry>
Aug 17 08:20:39 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:20:39 user nova-compute[72998]:     </system>
Aug 17 08:20:39 user nova-compute[72998]:   </sysinfo>
Aug 17 08:20:39 user nova-compute[72998]:   <os>
Aug 17 08:20:39 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:20:39 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:20:39 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:20:39 user nova-compute[72998]:   </os>
Aug 17 08:20:39 user nova-compute[72998]:   <features>
Aug 17 08:20:39 user nova-compute[72998]:     <acpi/>
Aug 17 08:20:39 user nova-compute[72998]:     <apic/>
Aug 17 08:20:39 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:20:39 user nova-compute[72998]:   </features>
Aug 17 08:20:39 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:20:39 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:20:39 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:20:39 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:20:39 user nova-compute[72998]:   </clock>
Aug 17 08:20:39 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:20:39 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:20:39 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:20:39 user nova-compute[72998]:   </cpu>
Aug 17 08:20:39 user nova-compute[72998]:   <devices>
Aug 17 08:20:39 user nova-compute[72998]:     <disk type="file" device="cdrom">
Aug 17 08:20:39 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 08:20:39 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/24f6cff0-793a-48ae-bd48-b276e9580897/disk.config"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="hda" bus="ide"/>
Aug 17 08:20:39 user nova-compute[72998]:     </disk>
Aug 17 08:20:39 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:20:39 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:20:39 user nova-compute[72998]:       <source dev="/dev/sdf"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <serial>3f91b5a5-ba2c-4844-851e-7f31b2b7d035</serial>
Aug 17 08:20:39 user nova-compute[72998]:     </disk>
Aug 17 08:20:39 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:20:39 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:20:39 user nova-compute[72998]:       <source dev="/dev/sdg"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <serial>0e40e127-3c2b-403a-be7e-7740290e26ae</serial>
Aug 17 08:20:39 user nova-compute[72998]:     </disk>
Aug 17 08:20:39 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:20:39 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:20:39 user nova-compute[72998]:       <source dev="/dev/sdh"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="vdc" bus="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <serial>951757d9-dcef-4db4-9b14-1536137ada76</serial>
Aug 17 08:20:39 user nova-compute[72998]:     </disk>
Aug 17 08:20:39 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:39 user nova-compute[72998]:       <mac address="fa:16:3e:8c:11:9f"/>
Aug 17 08:20:39 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="tapf8f7f651-70"/>
Aug 17 08:20:39 user nova-compute[72998]:     </interface>
Aug 17 08:20:39 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:39 user nova-compute[72998]:       <mac address="fa:16:3e:7a:b3:44"/>
Aug 17 08:20:39 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="tap45f6182c-00"/>
Aug 17 08:20:39 user nova-compute[72998]:     </interface>
Aug 17 08:20:39 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:39 user nova-compute[72998]:       <mac address="fa:16:3e:dc:4b:4e"/>
Aug 17 08:20:39 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="tape7b6ef84-57"/>
Aug 17 08:20:39 user nova-compute[72998]:     </interface>
Aug 17 08:20:39 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:39 user nova-compute[72998]:       <mac address="fa:16:3e:6d:36:a9"/>
Aug 17 08:20:39 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="tap1b95d72a-55"/>
Aug 17 08:20:39 user nova-compute[72998]:     </interface>
Aug 17 08:20:39 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:39 user nova-compute[72998]:       <mac address="fa:16:3e:86:ce:93"/>
Aug 17 08:20:39 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="tapba954fc7-e9"/>
Aug 17 08:20:39 user nova-compute[72998]:     </interface>
Aug 17 08:20:39 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:39 user nova-compute[72998]:       <mac address="fa:16:3e:93:0c:bc"/>
Aug 17 08:20:39 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="tap0d4a0aba-07"/>
Aug 17 08:20:39 user nova-compute[72998]:     </interface>
Aug 17 08:20:39 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:39 user nova-compute[72998]:       <mac address="fa:16:3e:ce:98:17"/>
Aug 17 08:20:39 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:39 user nova-compute[72998]:       <target dev="tapaf095d56-0f"/>
Aug 17 08:20:39 user nova-compute[72998]:     </interface>
Aug 17 08:20:39 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:20:39 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/24f6cff0-793a-48ae-bd48-b276e9580897/console.log" append="off"/>
Aug 17 08:20:39 user nova-compute[72998]:     </serial>
Aug 17 08:20:39 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:20:39 user nova-compute[72998]:     <video>
Aug 17 08:20:39 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:39 user nova-compute[72998]:     </video>
Aug 17 08:20:39 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:20:39 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:20:39 user nova-compute[72998]:     </rng>
Aug 17 08:20:39 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:20:39 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:20:39 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:20:39 user nova-compute[72998]:     </memballoon>
Aug 17 08:20:39 user nova-compute[72998]:   </devices>
Aug 17 08:20:39 user nova-compute[72998]: </domain>
Aug 17 08:20:39 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:9f,bridge_name='br-int',has_traffic_filtering=True,id=f8f7f651-7001-4a2f-9a3f-845df27fb248,network=Network(8050f3d2-b71c-4064-888d-359e11222fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f7f651-70') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:9f,bridge_name='br-int',has_traffic_filtering=True,id=f8f7f651-7001-4a2f-9a3f-845df27fb248,network=Network(8050f3d2-b71c-4064-888d-359e11222fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f7f651-70') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8f7f651-70, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8f7f651-70, col_values=(('external_ids', {'iface-id': 'f8f7f651-7001-4a2f-9a3f-845df27fb248', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:11:9f', 'vm-uuid': '24f6cff0-793a-48ae-bd48-b276e9580897'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: INFO os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:11:9f,bridge_name='br-int',has_traffic_filtering=True,id=f8f7f651-7001-4a2f-9a3f-845df27fb248,network=Network(8050f3d2-b71c-4064-888d-359e11222fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f7f651-70')
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=45f6182c-0023-4956-b6c9-69cf1980698c,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f6182c-00') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=45f6182c-0023-4956-b6c9-69cf1980698c,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f6182c-00') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45f6182c-00, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45f6182c-00, col_values=(('external_ids', {'iface-id': '45f6182c-0023-4956-b6c9-69cf1980698c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:b3:44', 'vm-uuid': '24f6cff0-793a-48ae-bd48-b276e9580897'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: INFO os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=45f6182c-0023-4956-b6c9-69cf1980698c,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f6182c-00')
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=e7b6ef84-57ee-4d09-a074-2a379d73789e,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7b6ef84-57') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=e7b6ef84-57ee-4d09-a074-2a379d73789e,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7b6ef84-57') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7b6ef84-57, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7b6ef84-57, col_values=(('external_ids', {'iface-id': 'e7b6ef84-57ee-4d09-a074-2a379d73789e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:4b:4e', 'vm-uuid': '24f6cff0-793a-48ae-bd48-b276e9580897'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: INFO os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=e7b6ef84-57ee-4d09-a074-2a379d73789e,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7b6ef84-57')
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:36:a9,bridge_name='br-int',has_traffic_filtering=True,id=1b95d72a-55c1-4b66-8a9d-66c093e4c77a,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b95d72a-55') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:36:a9,bridge_name='br-int',has_traffic_filtering=True,id=1b95d72a-55c1-4b66-8a9d-66c093e4c77a,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b95d72a-55') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b95d72a-55, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b95d72a-55, col_values=(('external_ids', {'iface-id': '1b95d72a-55c1-4b66-8a9d-66c093e4c77a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:36:a9', 'vm-uuid': '24f6cff0-793a-48ae-bd48-b276e9580897'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: INFO os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:36:a9,bridge_name='br-int',has_traffic_filtering=True,id=1b95d72a-55c1-4b66-8a9d-66c093e4c77a,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b95d72a-55')
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ce:93,bridge_name='br-int',has_traffic_filtering=True,id=ba954fc7-e9d4-42b5-b321-cd7269e42fb4,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba954fc7-e9') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ce:93,bridge_name='br-int',has_traffic_filtering=True,id=ba954fc7-e9d4-42b5-b321-cd7269e42fb4,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba954fc7-e9') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba954fc7-e9, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba954fc7-e9, col_values=(('external_ids', {'iface-id': 'ba954fc7-e9d4-42b5-b321-cd7269e42fb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:ce:93', 'vm-uuid': '24f6cff0-793a-48ae-bd48-b276e9580897'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: INFO os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ce:93,bridge_name='br-int',has_traffic_filtering=True,id=ba954fc7-e9d4-42b5-b321-cd7269e42fb4,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba954fc7-e9')
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=0d4a0aba-073f-4cc5-9314-46f5e0b0468a,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4a0aba-07') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=0d4a0aba-073f-4cc5-9314-46f5e0b0468a,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4a0aba-07') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d4a0aba-07, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d4a0aba-07, col_values=(('external_ids', {'iface-id': '0d4a0aba-073f-4cc5-9314-46f5e0b0468a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:0c:bc', 'vm-uuid': '24f6cff0-793a-48ae-bd48-b276e9580897'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: INFO os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=0d4a0aba-073f-4cc5-9314-46f5e0b0468a,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4a0aba-07')
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:98:17,bridge_name='br-int',has_traffic_filtering=True,id=af095d56-0fdd-44aa-bbd7-8dbc65a39804,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf095d56-0f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:98:17,bridge_name='br-int',has_traffic_filtering=True,id=af095d56-0fdd-44aa-bbd7-8dbc65a39804,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf095d56-0f') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf095d56-0f, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf095d56-0f, col_values=(('external_ids', {'iface-id': 'af095d56-0fdd-44aa-bbd7-8dbc65a39804', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:98:17', 'vm-uuid': '24f6cff0-793a-48ae-bd48-b276e9580897'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:39 user nova-compute[72998]: INFO os_vif [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:98:17,bridge_name='br-int',has_traffic_filtering=True,id=af095d56-0fdd-44aa-bbd7-8dbc65a39804,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf095d56-0f')
Aug 17 08:20:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] No BDM found with device name hda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] No VIF found with MAC fa:16:3e:8c:11:9f, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] No VIF found with MAC fa:16:3e:86:ce:93, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:20:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Using config drive
Aug 17 08:20:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Creating config drive at /opt/stack/data/nova/instances/24f6cff0-793a-48ae-bd48-b276e9580897/disk.config
Aug 17 08:20:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/24f6cff0-793a-48ae-bd48-b276e9580897/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5y54j3l1 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/24f6cff0-793a-48ae-bd48-b276e9580897/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5y54j3l1" returned: 0 in 0.080s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:20:40 user nova-compute[72998]: INFO nova.compute.claims [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Claim successful on node user
Aug 17 08:20:41 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:20:41 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:20:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG nova.policy [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39227b3a71d243a3acafa9317a45e691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f95e7d214049b3831b038a0f0c4d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:20:41 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Creating image(s)
Aug 17 08:20:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "/opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "/opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "4417d2aafdb3fcb185517f4425d44c563602af4c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "4417d2aafdb3fcb185517f4425d44c563602af4c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Successfully created port: 9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-9a8be82a-2373-4b16-a144-4accf4d6dc6b req-68dcad39-73a5-437f-b124-f0fa0fe14763 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9a8be82a-2373-4b16-a144-4accf4d6dc6b req-68dcad39-73a5-437f-b124-f0fa0fe14763 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9a8be82a-2373-4b16-a144-4accf4d6dc6b req-68dcad39-73a5-437f-b124-f0fa0fe14763 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9a8be82a-2373-4b16-a144-4accf4d6dc6b req-68dcad39-73a5-437f-b124-f0fa0fe14763 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-9a8be82a-2373-4b16-a144-4accf4d6dc6b req-68dcad39-73a5-437f-b124-f0fa0fe14763 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:42 user nova-compute[72998]: WARNING nova.compute.manager [req-9a8be82a-2373-4b16-a144-4accf4d6dc6b req-68dcad39-73a5-437f-b124-f0fa0fe14763 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 for instance with vm_state building and task_state spawning.
Aug 17 08:20:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c.part --force-share --output=json" returned: 0 in 0.242s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG nova.virt.images [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] 262dff16-5489-46bf-80fb-c261115e81c6 was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:20:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c.part /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c.part /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c.converted" returned: 0 in 0.608s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-ab254d14-6d6a-4486-8a08-b2d36334f134 req-1b20f585-81b3-4f9b-99fc-673193f349eb service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ab254d14-6d6a-4486-8a08-b2d36334f134 req-1b20f585-81b3-4f9b-99fc-673193f349eb service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ab254d14-6d6a-4486-8a08-b2d36334f134 req-1b20f585-81b3-4f9b-99fc-673193f349eb service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ab254d14-6d6a-4486-8a08-b2d36334f134 req-1b20f585-81b3-4f9b-99fc-673193f349eb service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-ab254d14-6d6a-4486-8a08-b2d36334f134 req-1b20f585-81b3-4f9b-99fc-673193f349eb service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:43 user nova-compute[72998]: WARNING nova.compute.manager [req-ab254d14-6d6a-4486-8a08-b2d36334f134 req-1b20f585-81b3-4f9b-99fc-673193f349eb service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-e7b6ef84-57ee-4d09-a074-2a379d73789e for instance with vm_state building and task_state spawning.
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c.converted --force-share --output=json" returned: 0 in 0.334s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "4417d2aafdb3fcb185517f4425d44c563602af4c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.136s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c --force-share --output=json" returned: 0 in 0.207s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "4417d2aafdb3fcb185517f4425d44c563602af4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "4417d2aafdb3fcb185517f4425d44c563602af4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-54d68671-24c3-4df0-be9b-b2fc3c6163d4 req-aac2207e-dbda-4adc-8a86-3323ce7d445e service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-54d68671-24c3-4df0-be9b-b2fc3c6163d4 req-aac2207e-dbda-4adc-8a86-3323ce7d445e service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-54d68671-24c3-4df0-be9b-b2fc3c6163d4 req-aac2207e-dbda-4adc-8a86-3323ce7d445e service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-54d68671-24c3-4df0-be9b-b2fc3c6163d4 req-aac2207e-dbda-4adc-8a86-3323ce7d445e service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-54d68671-24c3-4df0-be9b-b2fc3c6163d4 req-aac2207e-dbda-4adc-8a86-3323ce7d445e service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:44 user nova-compute[72998]: WARNING nova.compute.manager [req-54d68671-24c3-4df0-be9b-b2fc3c6163d4 req-aac2207e-dbda-4adc-8a86-3323ce7d445e service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a for instance with vm_state building and task_state spawning.
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Successfully updated port: 9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c --force-share --output=json" returned: 0 in 0.299s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c,backing_fmt=raw /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquired lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c,backing_fmt=raw /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk 1073741824" returned: 0 in 0.105s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "4417d2aafdb3fcb185517f4425d44c563602af4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.407s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:44 user nova-compute[72998]: WARNING nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 for instance with vm_state building and task_state spawning.
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:44 user nova-compute[72998]: WARNING nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-45f6182c-0023-4956-b6c9-69cf1980698c for instance with vm_state building and task_state spawning.
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:44 user nova-compute[72998]: WARNING nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-45f6182c-0023-4956-b6c9-69cf1980698c for instance with vm_state building and task_state spawning.
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:44 user nova-compute[72998]: WARNING nova.compute.manager [req-6bf47231-0a8b-4ce7-bccc-20ed17f899b8 req-2b3f3339-7188-4378-aa7f-c9ae0ccad509 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 for instance with vm_state building and task_state spawning.
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c --force-share --output=json" returned: 0 in 0.270s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'migration_context' on Instance uuid 8ce248f4-ac65-4c06-81c0-d24816ad7f09 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Ensure instance console log exists: /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Updating instance_info_cache with network_info: [{"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Releasing lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Instance network_info: |[{"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Start _get_guest_xml network_info=[{"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9ccc0fed821464e6cf82c8064566fd9b',container_format='bare',created_at=2023-08-17T08:20:30Z,direct_url=<?>,disk_format='qcow2',id=262dff16-5489-46bf-80fb-c261115e81c6,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1806814829',owner='74f95e7d214049b3831b038a0f0c4d8c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T08:20:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '262dff16-5489-46bf-80fb-c261115e81c6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:20:45 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:20:45 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9ccc0fed821464e6cf82c8064566fd9b',container_format='bare',created_at=2023-08-17T08:20:30Z,direct_url=<?>,disk_format='qcow2',id=262dff16-5489-46bf-80fb-c261115e81c6,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1806814829',owner='74f95e7d214049b3831b038a0f0c4d8c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T08:20:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1739831247',display_name='tempest-TestStampPattern-server-1739831247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1739831247',id=18,image_ref='262dff16-5489-46bf-80fb-c261115e81c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONZnqz4fz+N+JdDC9+VNVpRQxh6Mlne8ooU/TM1lcGerNueG6YDdZwYx4ZrGiVscocoQaLxw+uf1ndX7MqRoz/Bmg7lB1XGzA+NMiG3jzsbCxCIyBAvUWgKK/6+2DK/Eg==',key_name='tempest-TestStampPattern-1214740701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f95e7d214049b3831b038a0f0c4d8c',ramdisk_id='',reservation_id='r-8xbpg1iw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='cfbd3131-e61b-45a4-8c69-91081320f046',image_min_disk='1',image_min_ram='0',image_owner_id='74f95e7d214049b3831b038a0f0c4d8c',image_owner_project_name='tempest-TestStampPattern-795414078',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-795414078-project-member',image_user_id='39227b3a71d243a3acafa9317a45e691',network_allocated='True',owner_project_name='tempest-TestStampPattern-795414078',owner_user_name='tempest-TestStampPattern-795414078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:20:42Z,user_data=None,user_id='39227b3a71d243a3acafa9317a45e691',uuid=8ce248f4-ac65-4c06-81c0-d24816ad7f09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converting VIF {"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:54,bridge_name='br-int',has_traffic_filtering=True,id=9400f947-e6bc-41f9-8b42-9e68740ec3d5,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9400f947-e6') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ce248f4-ac65-4c06-81c0-d24816ad7f09 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:20:45 user nova-compute[72998]:   <uuid>8ce248f4-ac65-4c06-81c0-d24816ad7f09</uuid>
Aug 17 08:20:45 user nova-compute[72998]:   <name>instance-00000012</name>
Aug 17 08:20:45 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:20:45 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:20:45 user nova-compute[72998]:   <metadata>
Aug 17 08:20:45 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:20:45 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:20:45 user nova-compute[72998]:       <nova:name>tempest-TestStampPattern-server-1739831247</nova:name>
Aug 17 08:20:45 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:20:45</nova:creationTime>
Aug 17 08:20:45 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:20:45 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:20:45 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:20:45 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:20:45 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:20:45 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:20:45 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:20:45 user nova-compute[72998]:       <nova:owner>
Aug 17 08:20:45 user nova-compute[72998]:         <nova:user uuid="39227b3a71d243a3acafa9317a45e691">tempest-TestStampPattern-795414078-project-member</nova:user>
Aug 17 08:20:45 user nova-compute[72998]:         <nova:project uuid="74f95e7d214049b3831b038a0f0c4d8c">tempest-TestStampPattern-795414078</nova:project>
Aug 17 08:20:45 user nova-compute[72998]:       </nova:owner>
Aug 17 08:20:45 user nova-compute[72998]:       <nova:root type="image" uuid="262dff16-5489-46bf-80fb-c261115e81c6"/>
Aug 17 08:20:45 user nova-compute[72998]:       <nova:ports>
Aug 17 08:20:45 user nova-compute[72998]:         <nova:port uuid="9400f947-e6bc-41f9-8b42-9e68740ec3d5">
Aug 17 08:20:45 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 08:20:45 user nova-compute[72998]:         </nova:port>
Aug 17 08:20:45 user nova-compute[72998]:       </nova:ports>
Aug 17 08:20:45 user nova-compute[72998]:     </nova:instance>
Aug 17 08:20:45 user nova-compute[72998]:   </metadata>
Aug 17 08:20:45 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:20:45 user nova-compute[72998]:     <system>
Aug 17 08:20:45 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:20:45 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:20:45 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:20:45 user nova-compute[72998]:       <entry name="serial">8ce248f4-ac65-4c06-81c0-d24816ad7f09</entry>
Aug 17 08:20:45 user nova-compute[72998]:       <entry name="uuid">8ce248f4-ac65-4c06-81c0-d24816ad7f09</entry>
Aug 17 08:20:45 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:20:45 user nova-compute[72998]:     </system>
Aug 17 08:20:45 user nova-compute[72998]:   </sysinfo>
Aug 17 08:20:45 user nova-compute[72998]:   <os>
Aug 17 08:20:45 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:20:45 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:20:45 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:20:45 user nova-compute[72998]:   </os>
Aug 17 08:20:45 user nova-compute[72998]:   <features>
Aug 17 08:20:45 user nova-compute[72998]:     <acpi/>
Aug 17 08:20:45 user nova-compute[72998]:     <apic/>
Aug 17 08:20:45 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:20:45 user nova-compute[72998]:   </features>
Aug 17 08:20:45 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:20:45 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:20:45 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:20:45 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:20:45 user nova-compute[72998]:   </clock>
Aug 17 08:20:45 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:20:45 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:20:45 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:20:45 user nova-compute[72998]:   </cpu>
Aug 17 08:20:45 user nova-compute[72998]:   <devices>
Aug 17 08:20:45 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:20:45 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:20:45 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk"/>
Aug 17 08:20:45 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:20:45 user nova-compute[72998]:     </disk>
Aug 17 08:20:45 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:20:45 user nova-compute[72998]:       <mac address="fa:16:3e:6f:70:54"/>
Aug 17 08:20:45 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:45 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:20:45 user nova-compute[72998]:       <target dev="tap9400f947-e6"/>
Aug 17 08:20:45 user nova-compute[72998]:     </interface>
Aug 17 08:20:45 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:20:45 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/console.log" append="off"/>
Aug 17 08:20:45 user nova-compute[72998]:     </serial>
Aug 17 08:20:45 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:20:45 user nova-compute[72998]:     <video>
Aug 17 08:20:45 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:20:45 user nova-compute[72998]:     </video>
Aug 17 08:20:45 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:20:45 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:20:45 user nova-compute[72998]:     </rng>
Aug 17 08:20:45 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:20:45 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:20:45 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:20:45 user nova-compute[72998]:     </memballoon>
Aug 17 08:20:45 user nova-compute[72998]:   </devices>
Aug 17 08:20:45 user nova-compute[72998]: </domain>
Aug 17 08:20:45 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1739831247',display_name='tempest-TestStampPattern-server-1739831247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1739831247',id=18,image_ref='262dff16-5489-46bf-80fb-c261115e81c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONZnqz4fz+N+JdDC9+VNVpRQxh6Mlne8ooU/TM1lcGerNueG6YDdZwYx4ZrGiVscocoQaLxw+uf1ndX7MqRoz/Bmg7lB1XGzA+NMiG3jzsbCxCIyBAvUWgKK/6+2DK/Eg==',key_name='tempest-TestStampPattern-1214740701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f95e7d214049b3831b038a0f0c4d8c',ramdisk_id='',reservation_id='r-8xbpg1iw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='cfbd3131-e61b-45a4-8c69-91081320f046',image_min_disk='1',image_min_ram='0',image_owner_id='74f95e7d214049b3831b038a0f0c4d8c',image_owner_project_name='tempest-TestStampPattern-795414078',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-795414078-project-member',image_user_id='39227b3a71d243a3acafa9317a45e691',network_allocated='True',owner_project_name='tempest-TestStampPattern-795414078',owner_user_name='tempest-TestStampPattern-795414078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:20:42Z,user_data=None,user_id='39227b3a71d243a3acafa9317a45e691',uuid=8ce248f4-ac65-4c06-81c0-d24816ad7f09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converting VIF {"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:54,bridge_name='br-int',has_traffic_filtering=True,id=9400f947-e6bc-41f9-8b42-9e68740ec3d5,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9400f947-e6') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG os_vif [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:54,bridge_name='br-int',has_traffic_filtering=True,id=9400f947-e6bc-41f9-8b42-9e68740ec3d5,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9400f947-e6') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9400f947-e6, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9400f947-e6, col_values=(('external_ids', {'iface-id': '9400f947-e6bc-41f9-8b42-9e68740ec3d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:70:54', 'vm-uuid': '8ce248f4-ac65-4c06-81c0-d24816ad7f09'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: INFO os_vif [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:54,bridge_name='br-int',has_traffic_filtering=True,id=9400f947-e6bc-41f9-8b42-9e68740ec3d5,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9400f947-e6')
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No VIF found with MAC fa:16:3e:6f:70:54, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received event network-changed-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Refreshing instance network info cache due to event network-changed-9400f947-e6bc-41f9-8b42-9e68740ec3d5. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] Acquiring lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] Acquired lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Refreshing network info cache for port 9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:46 user nova-compute[72998]: WARNING nova.compute.manager [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a for instance with vm_state building and task_state spawning.
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:46 user nova-compute[72998]: WARNING nova.compute.manager [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 for instance with vm_state building and task_state spawning.
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:46 user nova-compute[72998]: WARNING nova.compute.manager [req-f3f532b4-3239-4fc0-8460-dc4ecf5c6665 req-8cb8d414-eaf7-40c9-864a-94efacf1bb38 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 for instance with vm_state building and task_state spawning.
Aug 17 08:20:46 user nova-compute[72998]: INFO nova.compute.manager [None req-9a07dbf1-f2a4-4a6a-909b-c33bede1147b tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Unrescuing
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9a07dbf1-f2a4-4a6a-909b-c33bede1147b tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9a07dbf1-f2a4-4a6a-909b-c33bede1147b tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquired lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9a07dbf1-f2a4-4a6a-909b-c33bede1147b tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:46 user nova-compute[72998]: WARNING nova.compute.manager [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 for instance with vm_state building and task_state spawning.
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:46 user nova-compute[72998]: WARNING nova.compute.manager [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a for instance with vm_state building and task_state spawning.
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:46 user nova-compute[72998]: WARNING nova.compute.manager [req-5eea1ce9-7110-4c7f-957d-5c98aca22bc8 req-80e91ad9-efac-40ba-aead-979f268a41ea service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a for instance with vm_state building and task_state spawning.
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Updated VIF entry in instance network info cache for port 9400f947-e6bc-41f9-8b42-9e68740ec3d5. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Updating instance_info_cache with network_info: [{"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] Releasing lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:46 user nova-compute[72998]: WARNING nova.compute.manager [req-67b99087-75da-40af-8320-d7f21f6587fc req-d21b482e-fe04-4e07-8eee-53251bffd37d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-e7b6ef84-57ee-4d09-a074-2a379d73789e for instance with vm_state building and task_state spawning.
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9a07dbf1-f2a4-4a6a-909b-c33bede1147b tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updating instance_info_cache with network_info: [{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9a07dbf1-f2a4-4a6a-909b-c33bede1147b tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Releasing lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9a07dbf1-f2a4-4a6a-909b-c33bede1147b tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'flavor' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260447.709901, 24f6cff0-793a-48ae-bd48-b276e9580897 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] VM Resumed (Lifecycle Event)
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:20:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance spawned successfully.
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260447.7165606, 24f6cff0-793a-48ae-bd48-b276e9580897 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] VM Started (Lifecycle Event)
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:20:47 user nova-compute[72998]: INFO nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Took 12.97 seconds to spawn the instance on the hypervisor.
Aug 17 08:20:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:48 user nova-compute[72998]: INFO nova.compute.manager [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Took 56.81 seconds to build instance.
Aug 17 08:20:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a0edeb3a-874d-4696-9837-5005f8cc6b4d tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "24f6cff0-793a-48ae-bd48-b276e9580897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.946s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "24f6cff0-793a-48ae-bd48-b276e9580897" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.787s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:48 user nova-compute[72998]: INFO nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "24f6cff0-793a-48ae-bd48-b276e9580897" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Instance destroyed successfully.
Aug 17 08:20:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received event network-vif-plugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] No waiting events found dispatching network-vif-plugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:48 user nova-compute[72998]: WARNING nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received unexpected event network-vif-plugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 for instance with vm_state building and task_state spawning.
Aug 17 08:20:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received event network-vif-plugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] No waiting events found dispatching network-vif-plugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:48 user nova-compute[72998]: WARNING nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received unexpected event network-vif-plugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 for instance with vm_state building and task_state spawning.
Aug 17 08:20:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-unplugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-unplugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:48 user nova-compute[72998]: WARNING nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-unplugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:20:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:48 user nova-compute[72998]: WARNING nova.compute.manager [req-6fc85e7a-471b-4cfb-a33d-471ac5fcda3e req-57057c00-159f-4294-b5aa-7c4e6c1a7553 service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260449.3937118, 8ce248f4-ac65-4c06-81c0-d24816ad7f09 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] VM Resumed (Lifecycle Event)
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Instance spawned successfully.
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:20:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260449.394721, 8ce248f4-ac65-4c06-81c0-d24816ad7f09 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] VM Started (Lifecycle Event)
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:20:49 user nova-compute[72998]: INFO nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Took 8.00 seconds to spawn the instance on the hypervisor.
Aug 17 08:20:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:49 user nova-compute[72998]: INFO nova.compute.manager [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Took 9.02 seconds to build instance.
Aug 17 08:20:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b958fce2-1e61-4479-bd40-71572fbfefd7 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.165s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:50 user nova-compute[72998]: WARNING nova.compute.manager [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:20:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:20:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:20:50 user nova-compute[72998]: WARNING nova.compute.manager [req-55f62382-cd5b-498d-b970-ceb668b5c5a9 req-12e85ca3-2bd7-4b22-9da3-416b7a3c0f6d service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:20:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for 0d992c9b-66c8-4bd9-b78e-51e13d662144 due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:20:52 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260452.2309146, 0d992c9b-66c8-4bd9-b78e-51e13d662144 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:52 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] VM Resumed (Lifecycle Event)
Aug 17 08:20:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9a07dbf1-f2a4-4a6a-909b-c33bede1147b tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:52 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 08:20:52 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260452.243156, 0d992c9b-66c8-4bd9-b78e-51e13d662144 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:20:52 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] VM Started (Lifecycle Event)
Aug 17 08:20:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:20:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:20:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:20:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:21:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:21:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:21:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:21:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:21:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updating instance_info_cache with network_info: [{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:21:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:21:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:21:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:21:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:21:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:21:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:21:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:21:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:21:03 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:21:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:21:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:21:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:21:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:21:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7253MB free_disk=24.26659393310547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cfbd3131-e61b-45a4-8c69-91081320f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 794e686e-2e6a-42f5-b817-5d18d2ad705e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance f79a3323-477f-4689-b8e3-35f2ff59a641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0c76033f-1eb7-4581-9e08-d262b4409c04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 24f6cff0-793a-48ae-bd48-b276e9580897 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8ce248f4-ac65-4c06-81c0-d24816ad7f09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:21:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:21:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:21:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:21:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:21:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:21:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:21:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:21:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:21:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:21:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:21:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:21:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:21:14 user nova-compute[72998]: INFO nova.compute.manager [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Terminating instance
Aug 17 08:21:14 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:21:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-e01a261c-6a66-433e-8e25-34947023f368 req-3b93081e-03d1-49f3-92ae-6da5335bf899 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received event network-vif-unplugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e01a261c-6a66-433e-8e25-34947023f368 req-3b93081e-03d1-49f3-92ae-6da5335bf899 service nova] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e01a261c-6a66-433e-8e25-34947023f368 req-3b93081e-03d1-49f3-92ae-6da5335bf899 service nova] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e01a261c-6a66-433e-8e25-34947023f368 req-3b93081e-03d1-49f3-92ae-6da5335bf899 service nova] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-e01a261c-6a66-433e-8e25-34947023f368 req-3b93081e-03d1-49f3-92ae-6da5335bf899 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] No waiting events found dispatching network-vif-unplugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-e01a261c-6a66-433e-8e25-34947023f368 req-3b93081e-03d1-49f3-92ae-6da5335bf899 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received event network-vif-unplugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Instance destroyed successfully.
Aug 17 08:21:15 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lazy-loading 'resources' on Instance uuid e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-191884981',display_name='tempest-VolumesAdminNegativeTest-server-191884981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-191884981',id=9,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc8gELbgZ7FG/6kW6Zh20T0v0wzhLNwt0EmjAU+PgOk6ae9Y70vwc40f93TUA8I3fQQS1YA6sWn9eSA5OE9ywJwCqbpgypKNV1p829qjwqzrNDlNTML61Y/3GyRo65TfA==',key_name='tempest-keypair-195077305',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b23b971dd054295802333297815ee12',ramdisk_id='',reservation_id='r-x8w4jehz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1447835405',owner_user_name='tempest-VolumesAdminNegativeTest-1447835405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e444ed21ebed454cb5c30943a5725f6b',uuid=e1f08a74-5ec5-4108-b17c-d8cc9380e5a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converting VIF {"id": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "address": "fa:16:3e:1d:ef:ff", "network": {"id": "5b65873e-c543-4a79-809a-5e528afdfd84", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1173394369-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b23b971dd054295802333297815ee12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc117be3-a7", "ovs_interfaceid": "fc117be3-a78c-4709-83d5-8f2ff3ecfe88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ef:ff,bridge_name='br-int',has_traffic_filtering=True,id=fc117be3-a78c-4709-83d5-8f2ff3ecfe88,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc117be3-a7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG os_vif [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ef:ff,bridge_name='br-int',has_traffic_filtering=True,id=fc117be3-a78c-4709-83d5-8f2ff3ecfe88,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc117be3-a7') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc117be3-a7, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:21:15 user nova-compute[72998]: INFO os_vif [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ef:ff,bridge_name='br-int',has_traffic_filtering=True,id=fc117be3-a78c-4709-83d5-8f2ff3ecfe88,network=Network(5b65873e-c543-4a79-809a-5e528afdfd84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc117be3-a7')
Aug 17 08:21:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Deleting instance files /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2_del
Aug 17 08:21:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Deletion of /opt/stack/data/nova/instances/e1f08a74-5ec5-4108-b17c-d8cc9380e5a2_del complete
Aug 17 08:21:15 user nova-compute[72998]: INFO nova.compute.manager [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 08:21:15 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:21:15 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:21:16 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:21:16 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Took 1.05 seconds to deallocate network for instance.
Aug 17 08:21:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-7969834a-a038-4fce-8489-72e2bd379009 req-e197f01f-a7d7-4685-93af-746b1770cee6 service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received event network-vif-deleted-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:21:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:21:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:21:17 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:21:17 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:21:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:21:17 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Deleted allocations for instance e1f08a74-5ec5-4108-b17c-d8cc9380e5a2
Aug 17 08:21:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-b009e530-0aed-4c7d-bd9a-f4a8fe26ccd2 req-8934a4c0-8510-4dfc-9bac-c9a5aabef16e service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received event network-vif-plugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:21:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b009e530-0aed-4c7d-bd9a-f4a8fe26ccd2 req-8934a4c0-8510-4dfc-9bac-c9a5aabef16e service nova] Acquiring lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:21:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b009e530-0aed-4c7d-bd9a-f4a8fe26ccd2 req-8934a4c0-8510-4dfc-9bac-c9a5aabef16e service nova] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:21:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b009e530-0aed-4c7d-bd9a-f4a8fe26ccd2 req-8934a4c0-8510-4dfc-9bac-c9a5aabef16e service nova] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:21:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-b009e530-0aed-4c7d-bd9a-f4a8fe26ccd2 req-8934a4c0-8510-4dfc-9bac-c9a5aabef16e service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] No waiting events found dispatching network-vif-plugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:21:17 user nova-compute[72998]: WARNING nova.compute.manager [req-b009e530-0aed-4c7d-bd9a-f4a8fe26ccd2 req-8934a4c0-8510-4dfc-9bac-c9a5aabef16e service nova] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Received unexpected event network-vif-plugged-fc117be3-a78c-4709-83d5-8f2ff3ecfe88 for instance with vm_state deleted and task_state None.
Aug 17 08:21:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3405d771-3389-49a0-b10f-438c600b3a88 tempest-VolumesAdminNegativeTest-1447835405 tempest-VolumesAdminNegativeTest-1447835405-project-member] Lock "e1f08a74-5ec5-4108-b17c-d8cc9380e5a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.531s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:21:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:30 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260475.5069118, e1f08a74-5ec5-4108-b17c-d8cc9380e5a2 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:21:30 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] VM Stopped (Lifecycle Event)
Aug 17 08:21:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1d1324b6-1ac0-461e-97b5-7d1dbc628e57 None None] [instance: e1f08a74-5ec5-4108-b17c-d8cc9380e5a2] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:21:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'flavor' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:21:35 user nova-compute[72998]: INFO nova.compute.manager [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Attaching volume 840d5785-2771-4304-bb85-08e411ebc715 to /dev/vdb
Aug 17 08:21:35 user nova-compute[72998]: DEBUG os_brick.utils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[067288e9-1157-468b-b358-39277892bdbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1b6eb8-1d7d-4069-a2f9-0dd5d5192017]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e252e4-6d58-4f32-a767-dc4ad8de6b1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[84908197-ff71-4169-94d1-14c155ddade0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:21:35 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:21:35 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c698908-73ba-4712-b3be-f9c1629225ce]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG os_brick.utils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:21:35 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating existing volume attachment record: 36eeede1-802c-4299-bbb7-989d7c5f9d08 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:21:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:21:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:21:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpRuPHnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:21:57 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:21:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:21:57 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:21:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:21:57 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9af8bce-cd39-4662-9d62-6d155346fc67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:21:57 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f602ba-6fa0-4173-a492-22e138d695c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715] added
Aug 17 08:21:57 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3cb8a5-4736-4e44-85ff-050098f8dc02]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d649b8-7938-4fdb-a2b9-4cb5a004a19f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:21:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpRuPHnJ {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpRuPHnJ" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[953f0610-fd47-4029-9418-661b7fd0a904]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rpRuPHnJ'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2494db79-3470-4eb3-a19b-aac2d8ab2e07]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d908ed-67eb-4b75-acde-ad3e2d8a22e6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eac4e2-a791-467e-82f7-83a476aaa2c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715, portal: 172.16.0.220,3260]
Aug 17 08:21:58 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715, portal: 172.16.0.220,3260] successful.
Aug 17 08:21:58 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[81752f8b-6dd1-4790-9e0f-f8e73ebf59d6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e9892c-4948-41e5-9742-ea1923947fe2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:21:58 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] HCTL ('40', '-', '-', 0) found on session 21 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5e5797-0581-42c9-bf1b-cf0b9b0c10c8]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Searching for a device in session 21 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:21:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpRuPHnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:21:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:21:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23862353231383562', 'path': '/dev/sdi'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:21:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862353231383562', 'path': '/dev/sdi'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:21:59 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'flavor' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:21:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:21:59 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:21:59 user nova-compute[72998]:   <source dev="/dev/sdi"/>
Aug 17 08:21:59 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:21:59 user nova-compute[72998]:   <serial>840d5785-2771-4304-bb85-08e411ebc715</serial>
Aug 17 08:21:59 user nova-compute[72998]: </disk>
Aug 17 08:21:59 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:21:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:21:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:21:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] No VIF found with MAC fa:16:3e:b4:7f:f0, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:21:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ced4c40-2797-4e78-b2c6-4518f028bde0 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.279s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:00 user nova-compute[72998]: INFO nova.compute.manager [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Rescuing
Aug 17 08:22:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquired lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating instance_info_cache with network_info: [{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Releasing lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updating instance_info_cache with network_info: [{"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG nova.compute.manager [req-3bc153e6-8ca2-4df3-936d-f3193fd006ef req-494e314d-cee5-4ef7-8e85-74567db9c12e service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-unplugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3bc153e6-8ca2-4df3-936d-f3193fd006ef req-494e314d-cee5-4ef7-8e85-74567db9c12e service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3bc153e6-8ca2-4df3-936d-f3193fd006ef req-494e314d-cee5-4ef7-8e85-74567db9c12e service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3bc153e6-8ca2-4df3-936d-f3193fd006ef req-494e314d-cee5-4ef7-8e85-74567db9c12e service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:01 user nova-compute[72998]: DEBUG nova.compute.manager [req-3bc153e6-8ca2-4df3-936d-f3193fd006ef req-494e314d-cee5-4ef7-8e85-74567db9c12e service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-unplugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:01 user nova-compute[72998]: WARNING nova.compute.manager [req-3bc153e6-8ca2-4df3-936d-f3193fd006ef req-494e314d-cee5-4ef7-8e85-74567db9c12e service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-unplugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state active and task_state rescuing.
Aug 17 08:22:02 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Instance destroyed successfully.
Aug 17 08:22:02 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Attempting a stable device rescue
Aug 17 08:22:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72998) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 08:22:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Instance directory exists: not creating {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 08:22:02 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Creating image(s)
Aug 17 08:22:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:02 user nova-compute[72998]: DEBUG nova.objects.instance [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'trusted_certs' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "742b665f389b49fab1719cbcc6f3df1004d9fd97" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "742b665f389b49fab1719cbcc6f3df1004d9fd97" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97.part --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG nova.virt.images [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] fa285d33-1afb-4997-9370-8ba9162db806 was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97.part /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97.part /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97.converted" returned: 0 in 0.298s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-3c9016cd-960e-4526-8a71-6185cfd6e659 req-8753549e-c7dd-4aa1-aebd-ead651c86837 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3c9016cd-960e-4526-8a71-6185cfd6e659 req-8753549e-c7dd-4aa1-aebd-ead651c86837 service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3c9016cd-960e-4526-8a71-6185cfd6e659 req-8753549e-c7dd-4aa1-aebd-ead651c86837 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3c9016cd-960e-4526-8a71-6185cfd6e659 req-8753549e-c7dd-4aa1-aebd-ead651c86837 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-3c9016cd-960e-4526-8a71-6185cfd6e659 req-8753549e-c7dd-4aa1-aebd-ead651c86837 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:03 user nova-compute[72998]: WARNING nova.compute.manager [req-3c9016cd-960e-4526-8a71-6185cfd6e659 req-8753549e-c7dd-4aa1-aebd-ead651c86837 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state active and task_state rescuing.
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "742b665f389b49fab1719cbcc6f3df1004d9fd97" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.765s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "742b665f389b49fab1719cbcc6f3df1004d9fd97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "742b665f389b49fab1719cbcc6f3df1004d9fd97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97 --force-share --output=json" returned: 0 in 0.211s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97,backing_fmt=raw /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97,backing_fmt=raw /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue" returned: 0 in 0.056s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "742b665f389b49fab1719cbcc6f3df1004d9fd97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.objects.instance [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'migration_context' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Start _get_guest_xml network_info=[{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "vif_mac": "fa:16:3e:b4:7f:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fa285d33-1afb-4997-9370-8ba9162db806', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '36eeede1-802c-4299-bbb7-989d7c5f9d08', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpRuPHnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '794e686e-2e6a-42f5-b817-5d18d2ad705e', 'attached_at': '', 'detached_at': '', 'volume_id': '840d5785-2771-4304-bb85-08e411ebc715', 'serial': '840d5785-2771-4304-bb85-08e411ebc715'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.objects.instance [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'resources' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.objects.instance [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'numa_topology' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:04 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:04 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.objects.instance [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'vcpu_model' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpRuPHnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:04 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:04 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:04 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a17ba-8cc8-48b5-9aab-190288afd37e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rpRuPHnJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 08:22:04 user nova-compute[72998]: node.name = iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715
Aug 17 08:22:04 user nova-compute[72998]: node.tpgt = -1
Aug 17 08:22:04 user nova-compute[72998]: node.startup = automatic
Aug 17 08:22:04 user nova-compute[72998]: node.leading_login = No
Aug 17 08:22:04 user nova-compute[72998]: iface.iscsi_ifacename = default
Aug 17 08:22:04 user nova-compute[72998]: iface.net_ifacename = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.ipaddress = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.prefix_len = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.hwaddress = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.transport_name = tcp
Aug 17 08:22:04 user nova-compute[72998]: iface.initiatorname = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.state = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.vlan_id = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.vlan_priority = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.vlan_state = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.iface_num = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.mtu = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.port = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.bootproto = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.subnet_mask = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.gateway = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.dhcp_alt_client_id = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.dhcp_dns = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.dhcp_learn_iqn = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.dhcp_vendor_id_state = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.dhcp_vendor_id = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.dhcp_slp_da = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.fragmentation = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.gratuitous_arp = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.incoming_forwarding = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.tos_state = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.tos = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.ttl = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.delayed_ack = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.tcp_nagle = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.tcp_wsf_state = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.tcp_wsf = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.tcp_timer_scale = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.tcp_timestamp = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.redirect = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.def_task_mgmt_timeout = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.header_digest = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.data_digest = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.immediate_data = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.initial_r2t = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.data_seq_inorder = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.data_pdu_inorder = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.erl = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.max_receive_data_len = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.first_burst_len = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.max_outstanding_r2t = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.max_burst_len = 0
Aug 17 08:22:04 user nova-compute[72998]: iface.chap_auth = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.bidi_chap = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.strict_login_compliance = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.discovery_auth = <empty>
Aug 17 08:22:04 user nova-compute[72998]: iface.discovery_logout = <empty>
Aug 17 08:22:04 user nova-compute[72998]: node.discovery_address = <empty>
Aug 17 08:22:04 user nova-compute[72998]: node.discovery_port = 0
Aug 17 08:22:04 user nova-compute[72998]: node.discovery_type = static
Aug 17 08:22:04 user nova-compute[72998]: node.session.initial_cmdsn = 0
Aug 17 08:22:04 user nova-compute[72998]: node.session.initial_login_retry_max = 8
Aug 17 08:22:04 user nova-compute[72998]: node.session.xmit_thread_priority = -20
Aug 17 08:22:04 user nova-compute[72998]: node.session.cmds_max = 128
Aug 17 08:22:04 user nova-compute[72998]: node.session.queue_depth = 32
Aug 17 08:22:04 user nova-compute[72998]: node.session.nr_sessions = 1
Aug 17 08:22:04 user nova-compute[72998]: node.session.auth.authmethod = CHAP
Aug 17 08:22:04 user nova-compute[72998]: node.session.auth.username = rpRuPHnJ
Aug 17 08:22:04 user nova-compute[72998]: node.session.auth.password = ***
Aug 17 08:22:04 user nova-compute[72998]: node.session.auth.username_in = <empty>
Aug 17 08:22:04 user nova-compute[72998]: node.session.auth.password_in = <empty>
Aug 17 08:22:04 user nova-compute[72998]: node.session.auth.chap_algs = MD5
Aug 17 08:22:04 user nova-compute[72998]: node.session.timeo.replacement_timeout = 120
Aug 17 08:22:04 user nova-compute[72998]: node.session.err_timeo.abort_timeout = 15
Aug 17 08:22:04 user nova-compute[72998]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 08:22:04 user nova-compute[72998]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 08:22:04 user nova-compute[72998]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.FastAbort = Yes
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.InitialR2T = No
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.ImmediateData = Yes
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.MaxConnections = 1
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 08:22:04 user nova-compute[72998]: node.session.iscsi.ERL = 0
Aug 17 08:22:04 user nova-compute[72998]: node.session.scan = manual
Aug 17 08:22:04 user nova-compute[72998]: node.session.reopen_max = 0
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].address = 172.16.0.220
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].port = 3260
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].startup = manual
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].tcp.window_size = 524288
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].tcp.type_of_service = 0
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].timeo.logout_timeout = 15
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].timeo.login_timeout = 15
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].timeo.auth_timeout = 45
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].iscsi.DataDigest = None
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].iscsi.IFMarker = No
Aug 17 08:22:04 user nova-compute[72998]: node.conn[0].iscsi.OFMarker = No
Aug 17 08:22:04 user nova-compute[72998]: # END RECORD
Aug 17 08:22:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1c9cb4-08fa-418e-a3f0-fe7a4f6bd9e0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b61fd3c-9727-4304-a382-40d9639859f7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpRuPHnJ {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpRuPHnJ" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0acec7-1329-4da2-a65d-cbf982733725]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rpRuPHnJ'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd2b3de-4269-4ae7-b483-dc460f2e42e6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[84be2f57-8b62-40ec-8205-276d2f9fe066]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] HCTL ('40', '0', '0', 0) found on session 21 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e13302b-0bdd-4b98-96fe-86812bd54e0c]: (4, ('0 0 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Searching for a device in session 21 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpRuPHnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.265s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] <== connect_volume: return (267ms) {'type': 'block', 'scsi_wwn': '23862353231383562', 'path': '/dev/sdi'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862353231383562', 'path': '/dev/sdi'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-568118166',display_name='tempest-ServerStableDeviceRescueTest-server-568118166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-568118166',id=12,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFoA5hMyyiQ9viW/O8jFPBLdISk/aDucVxb9hWkjB2hv7CHUVFi3GGx9ludTZ07TvnXYluZDk6yEtsSALMXSKfg4YR4YfCFcRR4EFK//wWhiIg9gQCvwW+r9dNFcEDIdA==',key_name='tempest-keypair-1604276468',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0a5f424a6894c6ca4148962ede48515',ramdisk_id='',reservation_id='r-kxqkhjat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1264944838',owner_user_name='tempest-ServerStableDeviceRescueTest-1264944838-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:19:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c2d6611c58043b49fb9f2ab7ce26288',uuid=794e686e-2e6a-42f5-b817-5d18d2ad705e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "vif_mac": "fa:16:3e:b4:7f:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Converting VIF {"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "vif_mac": "fa:16:3e:b4:7f:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:7f:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f14bfc7-3d2d-4f6f-ad48-80946cac3cef,network=Network(bbdc418d-15ca-46dd-923d-86e61709d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f14bfc7-3d') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.objects.instance [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'pci_devices' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:22:04 user nova-compute[72998]:   <uuid>794e686e-2e6a-42f5-b817-5d18d2ad705e</uuid>
Aug 17 08:22:04 user nova-compute[72998]:   <name>instance-0000000c</name>
Aug 17 08:22:04 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:22:04 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:22:04 user nova-compute[72998]:   <metadata>
Aug 17 08:22:04 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:22:04 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:22:04 user nova-compute[72998]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-568118166</nova:name>
Aug 17 08:22:04 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:22:04</nova:creationTime>
Aug 17 08:22:04 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:22:04 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:22:04 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:22:04 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:22:04 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:22:04 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:22:04 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:22:04 user nova-compute[72998]:       <nova:owner>
Aug 17 08:22:04 user nova-compute[72998]:         <nova:user uuid="0c2d6611c58043b49fb9f2ab7ce26288">tempest-ServerStableDeviceRescueTest-1264944838-project-member</nova:user>
Aug 17 08:22:04 user nova-compute[72998]:         <nova:project uuid="e0a5f424a6894c6ca4148962ede48515">tempest-ServerStableDeviceRescueTest-1264944838</nova:project>
Aug 17 08:22:04 user nova-compute[72998]:       </nova:owner>
Aug 17 08:22:04 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:22:04 user nova-compute[72998]:       <nova:ports>
Aug 17 08:22:04 user nova-compute[72998]:         <nova:port uuid="4f14bfc7-3d2d-4f6f-ad48-80946cac3cef">
Aug 17 08:22:04 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 08:22:04 user nova-compute[72998]:         </nova:port>
Aug 17 08:22:04 user nova-compute[72998]:       </nova:ports>
Aug 17 08:22:04 user nova-compute[72998]:     </nova:instance>
Aug 17 08:22:04 user nova-compute[72998]:   </metadata>
Aug 17 08:22:04 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:22:04 user nova-compute[72998]:     <system>
Aug 17 08:22:04 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:22:04 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:22:04 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:22:04 user nova-compute[72998]:       <entry name="serial">794e686e-2e6a-42f5-b817-5d18d2ad705e</entry>
Aug 17 08:22:04 user nova-compute[72998]:       <entry name="uuid">794e686e-2e6a-42f5-b817-5d18d2ad705e</entry>
Aug 17 08:22:04 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:22:04 user nova-compute[72998]:     </system>
Aug 17 08:22:04 user nova-compute[72998]:   </sysinfo>
Aug 17 08:22:04 user nova-compute[72998]:   <os>
Aug 17 08:22:04 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:22:04 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:22:04 user nova-compute[72998]:   </os>
Aug 17 08:22:04 user nova-compute[72998]:   <features>
Aug 17 08:22:04 user nova-compute[72998]:     <acpi/>
Aug 17 08:22:04 user nova-compute[72998]:     <apic/>
Aug 17 08:22:04 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:22:04 user nova-compute[72998]:   </features>
Aug 17 08:22:04 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:22:04 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:22:04 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:22:04 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:22:04 user nova-compute[72998]:   </clock>
Aug 17 08:22:04 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:22:04 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:22:04 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:22:04 user nova-compute[72998]:   </cpu>
Aug 17 08:22:04 user nova-compute[72998]:   <devices>
Aug 17 08:22:04 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:22:04 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:22:04 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk"/>
Aug 17 08:22:04 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:22:04 user nova-compute[72998]:     </disk>
Aug 17 08:22:04 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:22:04 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:22:04 user nova-compute[72998]:       <source dev="/dev/sdi"/>
Aug 17 08:22:04 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:22:04 user nova-compute[72998]:       <serial>840d5785-2771-4304-bb85-08e411ebc715</serial>
Aug 17 08:22:04 user nova-compute[72998]:     </disk>
Aug 17 08:22:04 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:22:04 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:22:04 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue"/>
Aug 17 08:22:04 user nova-compute[72998]:       <target dev="vdc" bus="virtio"/>
Aug 17 08:22:04 user nova-compute[72998]:       <boot order="1"/>
Aug 17 08:22:04 user nova-compute[72998]:     </disk>
Aug 17 08:22:04 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:22:04 user nova-compute[72998]:       <mac address="fa:16:3e:b4:7f:f0"/>
Aug 17 08:22:04 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:22:04 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:22:04 user nova-compute[72998]:       <target dev="tap4f14bfc7-3d"/>
Aug 17 08:22:04 user nova-compute[72998]:     </interface>
Aug 17 08:22:04 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:22:04 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/console.log" append="off"/>
Aug 17 08:22:04 user nova-compute[72998]:     </serial>
Aug 17 08:22:04 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:22:04 user nova-compute[72998]:     <video>
Aug 17 08:22:04 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:22:04 user nova-compute[72998]:     </video>
Aug 17 08:22:04 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:22:04 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:22:04 user nova-compute[72998]:     </rng>
Aug 17 08:22:04 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:22:04 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:22:04 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:22:04 user nova-compute[72998]:     </memballoon>
Aug 17 08:22:04 user nova-compute[72998]:   </devices>
Aug 17 08:22:04 user nova-compute[72998]: </domain>
Aug 17 08:22:04 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:22:04 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Instance destroyed successfully.
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] No VIF found with MAC fa:16:3e:b4:7f:f0, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-25a92934-eda3-4a15-91f1-677ee499f92c req-3dd3c89d-a216-41e3-aac9-308afda7bfec service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-25a92934-eda3-4a15-91f1-677ee499f92c req-3dd3c89d-a216-41e3-aac9-308afda7bfec service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-25a92934-eda3-4a15-91f1-677ee499f92c req-3dd3c89d-a216-41e3-aac9-308afda7bfec service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-25a92934-eda3-4a15-91f1-677ee499f92c req-3dd3c89d-a216-41e3-aac9-308afda7bfec service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-25a92934-eda3-4a15-91f1-677ee499f92c req-3dd3c89d-a216-41e3-aac9-308afda7bfec service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:06 user nova-compute[72998]: WARNING nova.compute.manager [req-25a92934-eda3-4a15-91f1-677ee499f92c req-3dd3c89d-a216-41e3-aac9-308afda7bfec service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state active and task_state rescuing.
Aug 17 08:22:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-f7ce6e7e-0f7a-4dbe-9a33-434716dc047d req-b9754b02-fd2d-4b08-a982-9910f3433e4c service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7ce6e7e-0f7a-4dbe-9a33-434716dc047d req-b9754b02-fd2d-4b08-a982-9910f3433e4c service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7ce6e7e-0f7a-4dbe-9a33-434716dc047d req-b9754b02-fd2d-4b08-a982-9910f3433e4c service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7ce6e7e-0f7a-4dbe-9a33-434716dc047d req-b9754b02-fd2d-4b08-a982-9910f3433e4c service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-f7ce6e7e-0f7a-4dbe-9a33-434716dc047d req-b9754b02-fd2d-4b08-a982-9910f3433e4c service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:08 user nova-compute[72998]: WARNING nova.compute.manager [req-f7ce6e7e-0f7a-4dbe-9a33-434716dc047d req-b9754b02-fd2d-4b08-a982-9910f3433e4c service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state active and task_state rescuing.
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for 794e686e-2e6a-42f5-b817-5d18d2ad705e due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260528.4558525, 794e686e-2e6a-42f5-b817-5d18d2ad705e => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:08 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] VM Resumed (Lifecycle Event)
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-25f811cf-902a-4d2d-8c1b-10a4893a6970 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7506MB free_disk=24.18796157836914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:22:08 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 08:22:08 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260528.456106, 794e686e-2e6a-42f5-b817-5d18d2ad705e => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:08 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] VM Started (Lifecycle Event)
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cfbd3131-e61b-45a4-8c69-91081320f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 794e686e-2e6a-42f5-b817-5d18d2ad705e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance f79a3323-477f-4689-b8e3-35f2ff59a641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0c76033f-1eb7-4581-9e08-d262b4409c04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 24f6cff0-793a-48ae-bd48-b276e9580897 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8ce248f4-ac65-4c06-81c0-d24816ad7f09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:22:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.966s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:22:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:22:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:16 user nova-compute[72998]: INFO nova.compute.manager [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Unshelving
Aug 17 08:22:16 user nova-compute[72998]: INFO nova.virt.block_device [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Booting with volume 58a4a0a1-06ea-459f-b640-66890e7be1e7 at /dev/vdc
Aug 17 08:22:16 user nova-compute[72998]: DEBUG os_brick.utils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce48dfa-2ab9-473b-9211-156a05d0ca81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d02ec1-8ec2-4421-8546-8bc1eecb2dbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0653859e-cc52-48e3-a2d5-3eedafeb1bf7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cfc77f-7965-4c92-84c1-c7b8a5185f99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:22:16 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:22:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c928eae-f53c-446d-ae97-d48e1fbb2f2f]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG os_brick.utils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:16 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating existing volume attachment record: d467bfc6-db00-4b0f-9867-9bde90df441a {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:22:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:22:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:22:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:22:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-c8f53853-7b5c-4a61-8942-54b7bdfad39b req-f353fce1-5700-42ca-8e10-eaef99babbe3 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-changed-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-c8f53853-7b5c-4a61-8942-54b7bdfad39b req-f353fce1-5700-42ca-8e10-eaef99babbe3 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing instance network info cache due to event network-changed-dfe13d48-2d8d-418b-bbd3-d2ee257689d6. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:22:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c8f53853-7b5c-4a61-8942-54b7bdfad39b req-f353fce1-5700-42ca-8e10-eaef99babbe3 service nova] Acquiring lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c8f53853-7b5c-4a61-8942-54b7bdfad39b req-f353fce1-5700-42ca-8e10-eaef99babbe3 service nova] Acquired lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:22 user nova-compute[72998]: DEBUG nova.network.neutron [req-c8f53853-7b5c-4a61-8942-54b7bdfad39b req-f353fce1-5700-42ca-8e10-eaef99babbe3 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Refreshing network info cache for port dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:22:23 user nova-compute[72998]: DEBUG nova.network.neutron [req-c8f53853-7b5c-4a61-8942-54b7bdfad39b req-f353fce1-5700-42ca-8e10-eaef99babbe3 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updated VIF entry in instance network info cache for port dfe13d48-2d8d-418b-bbd3-d2ee257689d6. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:22:23 user nova-compute[72998]: DEBUG nova.network.neutron [req-c8f53853-7b5c-4a61-8942-54b7bdfad39b req-f353fce1-5700-42ca-8e10-eaef99babbe3 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [{"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c8f53853-7b5c-4a61-8942-54b7bdfad39b req-f353fce1-5700-42ca-8e10-eaef99babbe3 service nova] Releasing lock "refresh_cache-0c76033f-1eb7-4581-9e08-d262b4409c04" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:22:26 user nova-compute[72998]: INFO nova.compute.claims [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Claim successful on node user
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:26 user nova-compute[72998]: INFO nova.compute.manager [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Terminating instance
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-2591a03d-8fd3-40f8-9512-c121b044f788 req-6ea52c78-9be8-483c-a2c3-ca485ffb1372 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2591a03d-8fd3-40f8-9512-c121b044f788 req-6ea52c78-9be8-483c-a2c3-ca485ffb1372 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2591a03d-8fd3-40f8-9512-c121b044f788 req-6ea52c78-9be8-483c-a2c3-ca485ffb1372 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2591a03d-8fd3-40f8-9512-c121b044f788 req-6ea52c78-9be8-483c-a2c3-ca485ffb1372 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-2591a03d-8fd3-40f8-9512-c121b044f788 req-6ea52c78-9be8-483c-a2c3-ca485ffb1372 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-unplugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-2591a03d-8fd3-40f8-9512-c121b044f788 req-6ea52c78-9be8-483c-a2c3-ca485ffb1372 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:22:26 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:22:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:22:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-87440a51-3669-424c-8a6c-05ab8474d60a req-8501447b-6884-49cf-99d8-73c24a781aa1 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-87440a51-3669-424c-8a6c-05ab8474d60a req-8501447b-6884-49cf-99d8-73c24a781aa1 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-87440a51-3669-424c-8a6c-05ab8474d60a req-8501447b-6884-49cf-99d8-73c24a781aa1 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-87440a51-3669-424c-8a6c-05ab8474d60a req-8501447b-6884-49cf-99d8-73c24a781aa1 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-87440a51-3669-424c-8a6c-05ab8474d60a req-8501447b-6884-49cf-99d8-73c24a781aa1 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-unplugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-87440a51-3669-424c-8a6c-05ab8474d60a req-8501447b-6884-49cf-99d8-73c24a781aa1 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:22:27 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Creating image(s)
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "/opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "/opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG nova.policy [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf94d9d63f9e4e5a9d0a4f175fddff16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef0a0f5a7b6484483231263041317df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.213s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.246s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk 1073741824" returned: 0 in 0.059s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:22:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Cannot resize image /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'migration_context' on Instance uuid c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Ensure instance console log exists: /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Instance destroyed successfully.
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lazy-loading 'resources' on Instance uuid 0c76033f-1eb7-4581-9e08-d262b4409c04 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:b7:bc,bridge_name='br-int',has_traffic_filtering=True,id=dfe13d48-2d8d-418b-bbd3-d2ee257689d6,network=Network(ad0bf549-4cf4-4a6d-833e-bf8c51c8c615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe13d48-2d') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:b7:bc,bridge_name='br-int',has_traffic_filtering=True,id=dfe13d48-2d8d-418b-bbd3-d2ee257689d6,network=Network(ad0bf549-4cf4-4a6d-833e-bf8c51c8c615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe13d48-2d') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfe13d48-2d, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: INFO os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:b7:bc,bridge_name='br-int',has_traffic_filtering=True,id=dfe13d48-2d8d-418b-bbd3-d2ee257689d6,network=Network(ad0bf549-4cf4-4a6d-833e-bf8c51c8c615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe13d48-2d')
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb3401d-f2') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb3401d-f2') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eb3401d-f2, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: INFO os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eb3401d-f2')
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=b1002575-29c6-47ba-b59a-f56301313413,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1002575-29') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=b1002575-29c6-47ba-b59a-f56301313413,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1002575-29') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1002575-29, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: INFO os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=b1002575-29c6-47ba-b59a-f56301313413,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1002575-29')
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:9c,bridge_name='br-int',has_traffic_filtering=True,id=2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0c4dd2-d7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:9c,bridge_name='br-int',has_traffic_filtering=True,id=2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0c4dd2-d7') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f0c4dd2-d7, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Successfully created port: f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: INFO os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:9c,bridge_name='br-int',has_traffic_filtering=True,id=2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0c4dd2-d7')
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=ce6e7ec2-63bb-4fbb-9fbc-192e33b70022,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6e7ec2-63') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=ce6e7ec2-63bb-4fbb-9fbc-192e33b70022,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6e7ec2-63') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce6e7ec2-63, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: INFO os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:cd:70,bridge_name='br-int',has_traffic_filtering=True,id=ce6e7ec2-63bb-4fbb-9fbc-192e33b70022,network=Network(84a6456d-bae4-4a51-a97b-28a4f46aade0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6e7ec2-63')
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "address": "fa:16:3e:3a:99:ef", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4bb88-f3", "ovs_interfaceid": "7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:99:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4bb88-f3') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:99:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4bb88-f3') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ba4bb88-f3, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: INFO os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:99:ef,bridge_name='br-int',has_traffic_filtering=True,id=7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4bb88-f3')
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1848862296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1848862296',id=16,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI49QKdImee2mGx4wAy9s3Vnnn0VVBvPCk2wRtgE7l7vqwTfvi0D/vDnUHKxB+wSY8cYqt/2yb+zPG0t9UQQxp6Lr/LoxCZF3yQz2puniYrR/bmcloawBgoIY3GC+dditA==',key_name='tempest-keypair-609733738',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e98f8721de96438582bae61d057d202b',ramdisk_id='',reservation_id='r-j47oqip0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-848836101',owner_user_name='tempest-TaggedBootDevicesTest-848836101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5c3bceee1c54e19bad334ee473e4889',uuid=0c76033f-1eb7-4581-9e08-d262b4409c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converting VIF {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:1a,bridge_name='br-int',has_traffic_filtering=True,id=735cd582-44ee-4a10-ab3d-529677296802,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735cd582-44') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:1a,bridge_name='br-int',has_traffic_filtering=True,id=735cd582-44ee-4a10-ab3d-529677296802,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735cd582-44') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap735cd582-44, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:28 user nova-compute[72998]: INFO os_vif [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:1a,bridge_name='br-int',has_traffic_filtering=True,id=735cd582-44ee-4a10-ab3d-529677296802,network=Network(e1f28138-e7c7-410b-8273-0b5ff984d6b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735cd582-44')
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybStKMXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:28 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[479b33ef-6692-4924-bfd1-6852a7bed77a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[464cc5a8-b3f1-4afc-b2a7-f333dff3129b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464ce35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bacc1f-06a5-449c-a4ea-63cd5ed20769]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8693a5f0-d3b8-48b8-a608-6c41ab96f9b2]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d403e018-7051-4b46-9182-dd4ddf668c71]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[95caaf73-005f-4efb-9be6-13b6e570fd24]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:28 user nova-compute[72998]: WARNING nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 for instance with vm_state active and task_state deleting.
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-unplugged-b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-b1002575-29c6-47ba-b59a-f56301313413 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-b1002575-29c6-47ba-b59a-f56301313413 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:28 user nova-compute[72998]: WARNING nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-b1002575-29c6-47ba-b59a-f56301313413 for instance with vm_state active and task_state deleting.
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-unplugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:28 user nova-compute[72998]: WARNING nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 for instance with vm_state active and task_state deleting.
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-unplugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:28 user nova-compute[72998]: WARNING nova.compute.manager [req-2442dcfc-75fc-4cff-8e1a-ef4b311f2d86 req-60f48694-1589-4404-a25f-759694c91b41 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 for instance with vm_state active and task_state deleting.
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebca201-9ba5-49a3-9d50-aa9289542a9f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b883d2db-6ade-4abe-8412-b688f1d3ae21]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982, portal: 172.16.0.220,3260]
Aug 17 08:22:29 user nova-compute[72998]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0140a0-da2c-41e1-bfb5-e7d1e2ba4982 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[914c5c9d-04c3-4155-bff0-142fc762ecec]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] <== disconnect_volume: return (382ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'feSqyVRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:29 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:29 user nova-compute[72998]: WARNING nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205 for instance with vm_state active and task_state deleting.
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-unplugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:29 user nova-compute[72998]: WARNING nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c for instance with vm_state active and task_state deleting.
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-unplugged-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-92793a52-96e6-4e83-9ba1-5f0f8d3691bd req-5ae45f5d-4f3b-4257-8ee7-eec5327a3bbc service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-unplugged-735cd582-44ee-4a10-ab3d-529677296802 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4627742b-ac77-4b96-8593-de040ee4088e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a62a355-298d-4635-bc66-1b72c823c9e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4b4f4b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e'): ({'sdd'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Removing single pathed devices sdd {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee580598-bd5b-4d0a-9c42-c3c030c72fdb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfc4344-f19d-44c0-9f22-f45b3d9960e3]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Flushing IO for device /dev/sdd {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c1afb9-14e4-4309-bc8a-f6fcac36d037]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[81606678-600b-46b8-999b-09d5214224b9]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e68d98d-32d3-4d50-86b8-a162a331adec]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[495a39a2-1c5e-4579-b970-2c7f1b7c39ff]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e, portal: 172.16.0.220,3260]
Aug 17 08:22:29 user nova-compute[72998]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7033c41-a077-4de9-ab33-2544a6199b2e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b19001-82fd-48aa-ba36-2ed00a656114]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] <== disconnect_volume: return (330ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwlpCxGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:29 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a9a1ec-da8e-4868-b79d-31fd3a92542f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d1912e-51ab-4bd5-8c66-5d0af524180d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4b4f4b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab'): ({'sde'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Removing single pathed devices sde {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe71cf1c-ed01-4c21-a6fd-801f6df7f52d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4166ed34-6107-41e5-a7fc-5ef1049b4dbc]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Flushing IO for device /dev/sde {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b35c6a-ebd6-43f3-9a3f-818fa02b8291]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[574c3856-aaa7-42b1-a750-32e49092dabb]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da34f70-1f51-4f1d-a8d1-dd117addc4d9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fe1fb4-1373-4d2f-9cc5-426d218ceb4a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab, portal: 172.16.0.220,3260]
Aug 17 08:22:29 user nova-compute[72998]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4599d0ce-243a-45b2-97d6-b98d62908bab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c914448-b725-463f-a0b4-3781679f8e2a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] <== disconnect_volume: return (349ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:22:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Deleting instance files /opt/stack/data/nova/instances/0c76033f-1eb7-4581-9e08-d262b4409c04_del
Aug 17 08:22:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Deletion of /opt/stack/data/nova/instances/0c76033f-1eb7-4581-9e08-d262b4409c04_del complete
Aug 17 08:22:29 user nova-compute[72998]: INFO nova.compute.manager [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Took 3.58 seconds to destroy the instance on the hypervisor.
Aug 17 08:22:29 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:22:29 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:22:30 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Successfully updated port: f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:22:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquired lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:30 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:22:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:30 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updating instance_info_cache with network_info: [{"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'pci_requests' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Releasing lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Instance network_info: |[{"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Start _get_guest_xml network_info=[{"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:31 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:31 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:22:31 user nova-compute[72998]: INFO nova.compute.claims [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Claim successful on node user
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:22:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1622936382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1622936382',id=19,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-aa0ds4s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:22:27Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:22:76,bridge_name='br-int',has_traffic_filtering=True,id=f0936629-dd1e-4218-98cb-78c2d8267a97,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0936629-dd') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'pci_devices' on Instance uuid c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:22:31 user nova-compute[72998]:   <uuid>c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa</uuid>
Aug 17 08:22:31 user nova-compute[72998]:   <name>instance-00000013</name>
Aug 17 08:22:31 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:22:31 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:22:31 user nova-compute[72998]:   <metadata>
Aug 17 08:22:31 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:22:31 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:22:31 user nova-compute[72998]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1622936382</nova:name>
Aug 17 08:22:31 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:22:31</nova:creationTime>
Aug 17 08:22:31 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:22:31 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:22:31 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:22:31 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:22:31 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:22:31 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:22:31 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:22:31 user nova-compute[72998]:       <nova:owner>
Aug 17 08:22:31 user nova-compute[72998]:         <nova:user uuid="cf94d9d63f9e4e5a9d0a4f175fddff16">tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member</nova:user>
Aug 17 08:22:31 user nova-compute[72998]:         <nova:project uuid="0ef0a0f5a7b6484483231263041317df">tempest-ServerBootFromVolumeStableRescueTest-1298365870</nova:project>
Aug 17 08:22:31 user nova-compute[72998]:       </nova:owner>
Aug 17 08:22:31 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:22:31 user nova-compute[72998]:       <nova:ports>
Aug 17 08:22:31 user nova-compute[72998]:         <nova:port uuid="f0936629-dd1e-4218-98cb-78c2d8267a97">
Aug 17 08:22:31 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 08:22:31 user nova-compute[72998]:         </nova:port>
Aug 17 08:22:31 user nova-compute[72998]:       </nova:ports>
Aug 17 08:22:31 user nova-compute[72998]:     </nova:instance>
Aug 17 08:22:31 user nova-compute[72998]:   </metadata>
Aug 17 08:22:31 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:22:31 user nova-compute[72998]:     <system>
Aug 17 08:22:31 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:22:31 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:22:31 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:22:31 user nova-compute[72998]:       <entry name="serial">c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa</entry>
Aug 17 08:22:31 user nova-compute[72998]:       <entry name="uuid">c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa</entry>
Aug 17 08:22:31 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:22:31 user nova-compute[72998]:     </system>
Aug 17 08:22:31 user nova-compute[72998]:   </sysinfo>
Aug 17 08:22:31 user nova-compute[72998]:   <os>
Aug 17 08:22:31 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:22:31 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:22:31 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:22:31 user nova-compute[72998]:   </os>
Aug 17 08:22:31 user nova-compute[72998]:   <features>
Aug 17 08:22:31 user nova-compute[72998]:     <acpi/>
Aug 17 08:22:31 user nova-compute[72998]:     <apic/>
Aug 17 08:22:31 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:22:31 user nova-compute[72998]:   </features>
Aug 17 08:22:31 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:22:31 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:22:31 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:22:31 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:22:31 user nova-compute[72998]:   </clock>
Aug 17 08:22:31 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:22:31 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:22:31 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:22:31 user nova-compute[72998]:   </cpu>
Aug 17 08:22:31 user nova-compute[72998]:   <devices>
Aug 17 08:22:31 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:22:31 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:22:31 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk"/>
Aug 17 08:22:31 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:22:31 user nova-compute[72998]:     </disk>
Aug 17 08:22:31 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:22:31 user nova-compute[72998]:       <mac address="fa:16:3e:8b:22:76"/>
Aug 17 08:22:31 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:22:31 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:22:31 user nova-compute[72998]:       <target dev="tapf0936629-dd"/>
Aug 17 08:22:31 user nova-compute[72998]:     </interface>
Aug 17 08:22:31 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:22:31 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/console.log" append="off"/>
Aug 17 08:22:31 user nova-compute[72998]:     </serial>
Aug 17 08:22:31 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:22:31 user nova-compute[72998]:     <video>
Aug 17 08:22:31 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:22:31 user nova-compute[72998]:     </video>
Aug 17 08:22:31 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:22:31 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:22:31 user nova-compute[72998]:     </rng>
Aug 17 08:22:31 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:22:31 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:22:31 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:22:31 user nova-compute[72998]:     </memballoon>
Aug 17 08:22:31 user nova-compute[72998]:   </devices>
Aug 17 08:22:31 user nova-compute[72998]: </domain>
Aug 17 08:22:31 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:22:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1622936382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1622936382',id=19,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-aa0ds4s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:22:27Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:22:76,bridge_name='br-int',has_traffic_filtering=True,id=f0936629-dd1e-4218-98cb-78c2d8267a97,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0936629-dd') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG os_vif [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:22:76,bridge_name='br-int',has_traffic_filtering=True,id=f0936629-dd1e-4218-98cb-78c2d8267a97,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0936629-dd') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0936629-dd, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0936629-dd, col_values=(('external_ids', {'iface-id': 'f0936629-dd1e-4218-98cb-78c2d8267a97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:22:76', 'vm-uuid': 'c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:31 user nova-compute[72998]: INFO os_vif [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:22:76,bridge_name='br-int',has_traffic_filtering=True,id=f0936629-dd1e-4218-98cb-78c2d8267a97,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0936629-dd')
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No VIF found with MAC fa:16:3e:8b:22:76, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-plugged-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] Acquiring lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] No waiting events found dispatching network-vif-plugged-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:31 user nova-compute[72998]: WARNING nova.compute.manager [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received unexpected event network-vif-plugged-735cd582-44ee-4a10-ab3d-529677296802 for instance with vm_state active and task_state deleting.
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received event network-changed-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Refreshing instance network info cache due to event network-changed-f0936629-dd1e-4218-98cb-78c2d8267a97. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] Acquiring lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] Acquired lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.network.neutron [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Refreshing network info cache for port f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:22:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:31 user nova-compute[72998]: INFO nova.network.neutron [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating port 1177fb3c-1f8f-489c-ada6-748478daa64b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 08:22:32 user nova-compute[72998]: DEBUG nova.network.neutron [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updated VIF entry in instance network info cache for port f0936629-dd1e-4218-98cb-78c2d8267a97. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:22:32 user nova-compute[72998]: DEBUG nova.network.neutron [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updating instance_info_cache with network_info: [{"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-790dad77-6cfd-4d86-a0bb-c05b1ceb1062 req-c6034bbc-f6b3-4b61-9690-81e472f06c74 service nova] Releasing lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-b2eb6f32-7c95-4346-b744-545a4ea4f032 req-c5722846-f4c4-4a7d-86f3-08ae931db5a1 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-deleted-7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:33 user nova-compute[72998]: INFO nova.compute.manager [req-b2eb6f32-7c95-4346-b744-545a4ea4f032 req-c5722846-f4c4-4a7d-86f3-08ae931db5a1 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Neutron deleted interface 7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2; detaching it from the instance and deleting it from the info cache
Aug 17 08:22:33 user nova-compute[72998]: DEBUG nova.network.neutron [req-b2eb6f32-7c95-4346-b744-545a4ea4f032 req-c5722846-f4c4-4a7d-86f3-08ae931db5a1 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [{"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "address": "fa:16:3e:10:cd:70", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6e7ec2-63", "ovs_interfaceid": "ce6e7ec2-63bb-4fbb-9fbc-192e33b70022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-08d7d193-b44f-46fd-ad66-8a6e4d806099 req-96fc2a3d-81f3-444b-872e-fb27c8d4cc2b service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received event network-vif-plugged-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-08d7d193-b44f-46fd-ad66-8a6e4d806099 req-96fc2a3d-81f3-444b-872e-fb27c8d4cc2b service nova] Acquiring lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-08d7d193-b44f-46fd-ad66-8a6e4d806099 req-96fc2a3d-81f3-444b-872e-fb27c8d4cc2b service nova] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-08d7d193-b44f-46fd-ad66-8a6e4d806099 req-96fc2a3d-81f3-444b-872e-fb27c8d4cc2b service nova] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-08d7d193-b44f-46fd-ad66-8a6e4d806099 req-96fc2a3d-81f3-444b-872e-fb27c8d4cc2b service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] No waiting events found dispatching network-vif-plugged-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:33 user nova-compute[72998]: WARNING nova.compute.manager [req-08d7d193-b44f-46fd-ad66-8a6e4d806099 req-96fc2a3d-81f3-444b-872e-fb27c8d4cc2b service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received unexpected event network-vif-plugged-f0936629-dd1e-4218-98cb-78c2d8267a97 for instance with vm_state building and task_state spawning.
Aug 17 08:22:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-b2eb6f32-7c95-4346-b744-545a4ea4f032 req-c5722846-f4c4-4a7d-86f3-08ae931db5a1 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Detach interface failed, port_id=7ba4bb88-f3eb-4267-8f2e-4ff032eca8d2, reason: Instance 0c76033f-1eb7-4581-9e08-d262b4409c04 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-ce47bda9-448b-4f75-b2ba-13b3e3fb6023 req-a905f613-edbd-45e5-9594-5a95736a4e3a service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-changed-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-ce47bda9-448b-4f75-b2ba-13b3e3fb6023 req-a905f613-edbd-45e5-9594-5a95736a4e3a service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing instance network info cache due to event network-changed-f8f7f651-7001-4a2f-9a3f-845df27fb248. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ce47bda9-448b-4f75-b2ba-13b3e3fb6023 req-a905f613-edbd-45e5-9594-5a95736a4e3a service nova] Acquiring lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ce47bda9-448b-4f75-b2ba-13b3e3fb6023 req-a905f613-edbd-45e5-9594-5a95736a4e3a service nova] Acquired lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:33 user nova-compute[72998]: DEBUG nova.network.neutron [req-ce47bda9-448b-4f75-b2ba-13b3e3fb6023 req-a905f613-edbd-45e5-9594-5a95736a4e3a service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Refreshing network info cache for port f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG nova.objects.instance [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'flavor' on Instance uuid 8ce248f4-ac65-4c06-81c0-d24816ad7f09 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.012s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:34 user nova-compute[72998]: INFO nova.compute.manager [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Attaching volume a3c65c6c-1c3f-4688-8039-2f415e214fa9 to /dev/vdb
Aug 17 08:22:34 user nova-compute[72998]: DEBUG os_brick.utils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3333244-8b42-4e34-819b-e8d0189de52f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1083be0-d0ff-4357-bf47-295568f0a44b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9610b31f-cb37-4d3e-99fe-96cff67ff0d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c6bbfb-9946-4546-9dd9-c113c91dc14b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:22:34 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[578f49e5-32a2-4fd1-8840-2a79b2e6ee67]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG os_brick.utils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Updating existing volume attachment record: f897f930-6a81-4720-a978-44fd8762e9fa {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquired lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG nova.network.neutron [req-ce47bda9-448b-4f75-b2ba-13b3e3fb6023 req-a905f613-edbd-45e5-9594-5a95736a4e3a service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updated VIF entry in instance network info cache for port f8f7f651-7001-4a2f-9a3f-845df27fb248. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG nova.network.neutron [req-ce47bda9-448b-4f75-b2ba-13b3e3fb6023 req-a905f613-edbd-45e5-9594-5a95736a4e3a service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [{"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ce47bda9-448b-4f75-b2ba-13b3e3fb6023 req-a905f613-edbd-45e5-9594-5a95736a4e3a service nova] Releasing lock "refresh_cache-24f6cff0-793a-48ae-bd48-b276e9580897" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260555.0773525, c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] VM Resumed (Lifecycle Event)
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Instance spawned successfully.
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260555.0851617, c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] VM Started (Lifecycle Event)
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Took 8.09 seconds to spawn the instance on the hypervisor.
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating instance_info_cache with network_info: [{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Releasing lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Creating image(s)
Aug 17 08:22:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.objects.instance [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "c17245cf84ad5234b1817c51baa07a7f241bf650" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "c17245cf84ad5234b1817c51baa07a7f241bf650" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-e79c5cf3-9b8f-4572-abeb-c7a6ca51af04 req-4b486f29-c3d9-44b5-abae-dce32c69df81 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-deleted-ce6e7ec2-63bb-4fbb-9fbc-192e33b70022 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.compute.manager [req-e79c5cf3-9b8f-4572-abeb-c7a6ca51af04 req-4b486f29-c3d9-44b5-abae-dce32c69df81 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Neutron deleted interface ce6e7ec2-63bb-4fbb-9fbc-192e33b70022; detaching it from the instance and deleting it from the info cache
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-e79c5cf3-9b8f-4572-abeb-c7a6ca51af04 req-4b486f29-c3d9-44b5-abae-dce32c69df81 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [{"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "address": "fa:16:3e:fb:56:9c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0c4dd2-d7", "ovs_interfaceid": "2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.compute.manager [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Took 9.33 seconds to build instance.
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received event network-changed-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Refreshing instance network info cache due to event network-changed-9400f947-e6bc-41f9-8b42-9e68740ec3d5. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] Acquiring lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] Acquired lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Refreshing network info cache for port 9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f545a29d-1073-4e5d-a7d9-b00374ebb6a4 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.467s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-e79c5cf3-9b8f-4572-abeb-c7a6ca51af04 req-4b486f29-c3d9-44b5-abae-dce32c69df81 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Detach interface failed, port_id=ce6e7ec2-63bb-4fbb-9fbc-192e33b70022, reason: Instance 0c76033f-1eb7-4581-9e08-d262b4409c04 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-e79c5cf3-9b8f-4572-abeb-c7a6ca51af04 req-4b486f29-c3d9-44b5-abae-dce32c69df81 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-deleted-2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:35 user nova-compute[72998]: INFO nova.compute.manager [req-e79c5cf3-9b8f-4572-abeb-c7a6ca51af04 req-4b486f29-c3d9-44b5-abae-dce32c69df81 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Neutron deleted interface 2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c; detaching it from the instance and deleting it from the info cache
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-e79c5cf3-9b8f-4572-abeb-c7a6ca51af04 req-4b486f29-c3d9-44b5-abae-dce32c69df81 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [{"id": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "address": "fa:16:3e:41:b7:bc", "network": {"id": "ad0bf549-4cf4-4a6d-833e-bf8c51c8c615", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397005876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe13d48-2d", "ovs_interfaceid": "dfe13d48-2d8d-418b-bbd3-d2ee257689d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "address": "fa:16:3e:04:8b:5c", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb3401d-f2", "ovs_interfaceid": "2eb3401d-f2f1-4f6d-bafe-44b2d8bd2205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1002575-29c6-47ba-b59a-f56301313413", "address": "fa:16:3e:5b:2b:99", "network": {"id": "84a6456d-bae4-4a51-a97b-28a4f46aade0", "bridge": "br-int", "label": "tempest-device-tagging-net1-790737192", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1002575-29", "ovs_interfaceid": "b1002575-29c6-47ba-b59a-f56301313413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "735cd582-44ee-4a10-ab3d-529677296802", "address": "fa:16:3e:e1:a6:1a", "network": {"id": "e1f28138-e7c7-410b-8273-0b5ff984d6b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-929982963", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e98f8721de96438582bae61d057d202b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735cd582-44", "ovs_interfaceid": "735cd582-44ee-4a10-ab3d-529677296802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-e79c5cf3-9b8f-4572-abeb-c7a6ca51af04 req-4b486f29-c3d9-44b5-abae-dce32c69df81 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Detach interface failed, port_id=2f0c4dd2-d7ef-4b8a-996d-78e80c4f566c, reason: Instance 0c76033f-1eb7-4581-9e08-d262b4409c04 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:22:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650.part --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:36 user nova-compute[72998]: DEBUG nova.virt.images [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] 408413c7-90ba-4827-a322-8d3e6f4fd222 was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:22:36 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:22:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650.part /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650.part /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650.converted" returned: 0 in 0.306s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:37 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Took 7.37 seconds to deallocate network for instance.
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "24f6cff0-793a-48ae-bd48-b276e9580897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:37 user nova-compute[72998]: INFO nova.compute.manager [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Terminating instance
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Updated VIF entry in instance network info cache for port 9400f947-e6bc-41f9-8b42-9e68740ec3d5. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Updating instance_info_cache with network_info: [{"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] Releasing lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received event network-vif-plugged-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] Acquiring lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] No waiting events found dispatching network-vif-plugged-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:37 user nova-compute[72998]: WARNING nova.compute.manager [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received unexpected event network-vif-plugged-f0936629-dd1e-4218-98cb-78c2d8267a97 for instance with vm_state active and task_state None.
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-changed-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Refreshing instance network info cache due to event network-changed-1177fb3c-1f8f-489c-ada6-748478daa64b. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] Acquiring lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] Acquired lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Refreshing network info cache for port 1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650.converted --force-share --output=json" returned: 0 in 0.235s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "c17245cf84ad5234b1817c51baa07a7f241bf650" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.057s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-6837ad92-099e-4179-ae6a-edd86a3a3112 req-19fc8ed6-e7dd-483f-981d-b250cb47ce28 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-deleted-dfe13d48-2d8d-418b-bbd3-d2ee257689d6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-6837ad92-099e-4179-ae6a-edd86a3a3112 req-19fc8ed6-e7dd-483f-981d-b250cb47ce28 service nova] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Received event network-vif-deleted-735cd582-44ee-4a10-ab3d-529677296802 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650 --force-share --output=json" returned: 0 in 0.296s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "c17245cf84ad5234b1817c51baa07a7f241bf650" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "c17245cf84ad5234b1817c51baa07a7f241bf650" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-f5fbef53-4980-405a-a951-a5b93ac96012 req-8c17b72c-f34a-4551-a0f2-b7a8661248a6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f5fbef53-4980-405a-a951-a5b93ac96012 req-8c17b72c-f34a-4551-a0f2-b7a8661248a6 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f5fbef53-4980-405a-a951-a5b93ac96012 req-8c17b72c-f34a-4551-a0f2-b7a8661248a6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f5fbef53-4980-405a-a951-a5b93ac96012 req-8c17b72c-f34a-4551-a0f2-b7a8661248a6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-f5fbef53-4980-405a-a951-a5b93ac96012 req-8c17b72c-f34a-4551-a0f2-b7a8661248a6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-unplugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-f5fbef53-4980-405a-a951-a5b93ac96012 req-8c17b72c-f34a-4551-a0f2-b7a8661248a6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650 --force-share --output=json" returned: 0 in 0.380s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650,backing_fmt=raw /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650,backing_fmt=raw /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk 1073741824" returned: 0 in 0.089s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "c17245cf84ad5234b1817c51baa07a7f241bf650" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.481s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650 --force-share --output=json" returned: 0 in 0.266s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG nova.objects.instance [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'migration_context' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-7105fba8-79aa-41b9-828f-a00989942e15 req-95c9df13-e54d-47a4-b3d4-74e7d15fe5ef service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7105fba8-79aa-41b9-828f-a00989942e15 req-95c9df13-e54d-47a4-b3d4-74e7d15fe5ef service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7105fba8-79aa-41b9-828f-a00989942e15 req-95c9df13-e54d-47a4-b3d4-74e7d15fe5ef service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7105fba8-79aa-41b9-828f-a00989942e15 req-95c9df13-e54d-47a4-b3d4-74e7d15fe5ef service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-7105fba8-79aa-41b9-828f-a00989942e15 req-95c9df13-e54d-47a4-b3d4-74e7d15fe5ef service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-unplugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-7105fba8-79aa-41b9-828f-a00989942e15 req-95c9df13-e54d-47a4-b3d4-74e7d15fe5ef service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:38 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Rebasing disk image.
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.225s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 -F raw /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG nova.network.neutron [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updated VIF entry in instance network info cache for port 1177fb3c-1f8f-489c-ada6-748478daa64b. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG nova.network.neutron [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating instance_info_cache with network_info: [{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-09a7b5eb-a7df-4605-a021-8c3b5f0d3dd9 req-1c0a1c6a-1a57-432f-9742-3fa6659818e6 service nova] Releasing lock "refresh_cache-9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Instance destroyed successfully.
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lazy-loading 'resources' on Instance uuid 24f6cff0-793a-48ae-bd48-b276e9580897 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:11:9f,bridge_name='br-int',has_traffic_filtering=True,id=f8f7f651-7001-4a2f-9a3f-845df27fb248,network=Network(8050f3d2-b71c-4064-888d-359e11222fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f7f651-70') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:11:9f,bridge_name='br-int',has_traffic_filtering=True,id=f8f7f651-7001-4a2f-9a3f-845df27fb248,network=Network(8050f3d2-b71c-4064-888d-359e11222fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f7f651-70') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8f7f651-70, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: INFO os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:11:9f,bridge_name='br-int',has_traffic_filtering=True,id=f8f7f651-7001-4a2f-9a3f-845df27fb248,network=Network(8050f3d2-b71c-4064-888d-359e11222fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f7f651-70')
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=45f6182c-0023-4956-b6c9-69cf1980698c,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f6182c-00') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=45f6182c-0023-4956-b6c9-69cf1980698c,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f6182c-00') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45f6182c-00, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-unplugged-e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-e7b6ef84-57ee-4d09-a074-2a379d73789e for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-e7b6ef84-57ee-4d09-a074-2a379d73789e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:39 user nova-compute[72998]: WARNING nova.compute.manager [req-2842a5f4-4ba7-4269-a8f1-95dca6bc48b8 req-ea4cc369-598d-4ff1-9abc-3b546e36800d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-e7b6ef84-57ee-4d09-a074-2a379d73789e for instance with vm_state active and task_state deleting.
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: INFO os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b3:44,bridge_name='br-int',has_traffic_filtering=True,id=45f6182c-0023-4956-b6c9-69cf1980698c,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f6182c-00')
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=e7b6ef84-57ee-4d09-a074-2a379d73789e,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7b6ef84-57') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=e7b6ef84-57ee-4d09-a074-2a379d73789e,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7b6ef84-57') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7b6ef84-57, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: INFO os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=e7b6ef84-57ee-4d09-a074-2a379d73789e,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape7b6ef84-57')
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:36:a9,bridge_name='br-int',has_traffic_filtering=True,id=1b95d72a-55c1-4b66-8a9d-66c093e4c77a,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b95d72a-55') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:36:a9,bridge_name='br-int',has_traffic_filtering=True,id=1b95d72a-55c1-4b66-8a9d-66c093e4c77a,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b95d72a-55') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b95d72a-55, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: INFO os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:36:a9,bridge_name='br-int',has_traffic_filtering=True,id=1b95d72a-55c1-4b66-8a9d-66c093e4c77a,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b95d72a-55')
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ce:93,bridge_name='br-int',has_traffic_filtering=True,id=ba954fc7-e9d4-42b5-b321-cd7269e42fb4,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba954fc7-e9') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ce:93,bridge_name='br-int',has_traffic_filtering=True,id=ba954fc7-e9d4-42b5-b321-cd7269e42fb4,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba954fc7-e9') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba954fc7-e9, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:39 user nova-compute[72998]: INFO os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ce:93,bridge_name='br-int',has_traffic_filtering=True,id=ba954fc7-e9d4-42b5-b321-cd7269e42fb4,network=Network(00eabec7-6ec3-49c8-b5df-e75276671908),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba954fc7-e9')
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=0d4a0aba-073f-4cc5-9314-46f5e0b0468a,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4a0aba-07') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=0d4a0aba-073f-4cc5-9314-46f5e0b0468a,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4a0aba-07') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d4a0aba-07, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:40 user nova-compute[72998]: INFO os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=0d4a0aba-073f-4cc5-9314-46f5e0b0468a,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4a0aba-07')
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T08:19:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1145594164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1145594164',id=17,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL/uKfoxJysM5lOFd753Hw+mECZNs5q/OxGxn9rkXIKhDuZKf7+qhSFdJtXvcNNnB8G8/ptPv/kuMyL8YuQRF6Ejigv7pmXB3WZQmso9X+3CSG5mT4gfpkJLrN2Md2xhA==',key_name='tempest-keypair-709312275',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83124dfa96344a56b27b2f89eeda1976',ramdisk_id='',reservation_id='r-ip9u5k2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-21992590',owner_user_name='tempest-TaggedBootDevicesTest_v242-21992590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d037e26859554af98bbe00502a606744',uuid=24f6cff0-793a-48ae-bd48-b276e9580897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converting VIF {"id": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "address": "fa:16:3e:ce:98:17", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf095d56-0f", "ovs_interfaceid": "af095d56-0fdd-44aa-bbd7-8dbc65a39804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:98:17,bridge_name='br-int',has_traffic_filtering=True,id=af095d56-0fdd-44aa-bbd7-8dbc65a39804,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf095d56-0f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:98:17,bridge_name='br-int',has_traffic_filtering=True,id=af095d56-0fdd-44aa-bbd7-8dbc65a39804,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf095d56-0f') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf095d56-0f, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:40 user nova-compute[72998]: INFO os_vif [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:98:17,bridge_name='br-int',has_traffic_filtering=True,id=af095d56-0fdd-44aa-bbd7-8dbc65a39804,network=Network(46d2c75f-cb8f-4fe3-bfd7-a433e937de9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf095d56-0f')
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jsoPbBft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:40 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ba59b4-ca52-407b-b231-63adcf11373a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8308533f-dd24-40c8-b9fe-8e254b9c78c6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4885a7490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035'): ({'sdf'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Removing single pathed devices sdf {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0976106-0670-4a44-921c-40d54d180942]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:40 user nova-compute[72998]: WARNING nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-f8f7f651-7001-4a2f-9a3f-845df27fb248 for instance with vm_state active and task_state deleting.
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-unplugged-45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-45f6182c-0023-4956-b6c9-69cf1980698c for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-45f6182c-0023-4956-b6c9-69cf1980698c {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:40 user nova-compute[72998]: WARNING nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-45f6182c-0023-4956-b6c9-69cf1980698c for instance with vm_state active and task_state deleting.
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-unplugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-4331b950-36a1-4741-a447-672c47fe53e5 req-c1d7f749-f75b-4343-afd7-4ee9a270a1e6 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4983a892-1f52-4cb8-a4de-4508e10ca357]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Flushing IO for device /dev/sdf {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8920bfd-1a72-441a-a5ac-4970e3060701]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.140s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dc5a7b-2210-4729-8d3d-bc473a4db1dc]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] SCSI volumes sdf have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e3097d-7ff1-4147-9c12-25450b40b85a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20e5880-826c-4f05-801b-fc4c2b4b3ad7]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035, portal: 172.16.0.220,3260]
Aug 17 08:22:40 user nova-compute[72998]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:40 user nova-compute[72998]: WARNING nova.compute.manager [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-1b95d72a-55c1-4b66-8a9d-66c093e4c77a for instance with vm_state active and task_state deleting.
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-unplugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:40 user nova-compute[72998]: WARNING nova.compute.manager [req-3394380b-c8e7-4161-b05e-0db912e8dd73 req-8c1b0428-14cf-4799-b641-685cc7c832e3 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-af095d56-0fdd-44aa-bbd7-8dbc65a39804 for instance with vm_state active and task_state deleting.
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f91b5a5-ba2c-4844-851e-7f31b2b7d035 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb71277-2e98-42f6-a8fa-738bf7f32385]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.515s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] <== disconnect_volume: return (516ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFriHRNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:40 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[85840e00-7471-45a0-be73-dd55b84bbb85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[154eb29b-d0d5-4530-af8f-4a1bbe6e9bf5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4884c1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae'): ({'sdg'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Removing single pathed devices sdg {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabd0773-934f-4c2a-8b3e-735ba006d72e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[11620464-5c17-4aba-8b39-7b7e359fb355]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Flushing IO for device /dev/sdg {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6993de12-5292-4c33-bad2-43d5dd5efc17]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.069s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a84903d-326e-4830-b4f9-9de4e15867e6]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] SCSI volumes sdg have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb002e8-e564-4648-b55b-684132c6696f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28bd421-0ccb-4bdd-a277-e7d64a6bccd1]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae, portal: 172.16.0.220,3260]
Aug 17 08:22:41 user nova-compute[72998]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e40e127-3c2b-403a-be7e-7740290e26ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[17789063-a083-46ef-abdd-d31d3dbedc23]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] <== disconnect_volume: return (448ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RomTsrup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:41 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:22:41 user nova-compute[72998]: INFO nova.compute.manager [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Took 3.82 seconds to detach 3 volumes for instance.
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d11741-2f08-48ce-9290-a319290d9d79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[22106f69-7649-4604-82a1-4f53580bc348]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464e17130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76'): ({'sdh'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Removing single pathed devices sdh {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[21651418-427b-40e1-ad8d-19635c18ac76]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[23909a22-b8ea-424e-85c5-e47c45d282ee]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Flushing IO for device /dev/sdh {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[502a9739-0ede-4eec-872c-bf00183725a3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.072s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a133aa54-7783-4791-8a44-00deff2a608e]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] SCSI volumes sdh have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3df9d8-db08-44ab-8423-1f17fc892407]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[710a5d5c-7eea-4b78-9b33-9ccdb16c5ba1]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76, portal: 172.16.0.220,3260]
Aug 17 08:22:41 user nova-compute[72998]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951757d9-dcef-4db4-9b14-1536137ada76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a94a292-748e-4cc1-819a-767bcb32a30c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] <== disconnect_volume: return (400ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:22:41 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Deleting instance files /opt/stack/data/nova/instances/24f6cff0-793a-48ae-bd48-b276e9580897_del
Aug 17 08:22:41 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Deletion of /opt/stack/data/nova/instances/24f6cff0-793a-48ae-bd48-b276e9580897_del complete
Aug 17 08:22:41 user nova-compute[72998]: INFO nova.compute.manager [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Took 4.27 seconds to destroy the instance on the hypervisor.
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 -F raw /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk" returned: 0 in 2.933s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Ensure instance console log exists: /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Start _get_guest_xml network_info=[{"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d434eb1c523fa6b71ba2c234c88ba2db',container_format='bare',created_at=2023-08-17T08:20:23Z,direct_url=<?>,disk_format='qcow2',id=408413c7-90ba-4827-a322-8d3e6f4fd222,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1227355977-shelved',owner='846580b37b3545319d1897e07c828c59',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T08:20:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd467bfc6-db00-4b0f-9867-9bde90df441a', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTzPjVdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66', 'attached_at': '', 'detached_at': '', 'volume_id': '58a4a0a1-06ea-459f-b640-66890e7be1e7', 'serial': '58a4a0a1-06ea-459f-b640-66890e7be1e7'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:22:41 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:41 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d434eb1c523fa6b71ba2c234c88ba2db',container_format='bare',created_at=2023-08-17T08:20:23Z,direct_url=<?>,disk_format='qcow2',id=408413c7-90ba-4827-a322-8d3e6f4fd222,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1227355977-shelved',owner='846580b37b3545319d1897e07c828c59',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T08:20:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.objects.instance [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTzPjVdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:41 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:41 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:41 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:22:41 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1eab87-fc10-4ed3-938b-e349e4867f43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:22:41 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.674s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c4151a-aa6d-4003-88b2-1ccb906d9dd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7] added
Aug 17 08:22:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaba566-7a7f-46ab-ac3d-bfbcf909f422]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Deleted allocations for instance 0c76033f-1eb7-4581-9e08-d262b4409c04
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[affd6a5d-66b7-4c44-9b46-da65cc9dc2cc]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTzPjVdr {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTzPjVdr" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbd70f0-e0a3-427e-b7b6-a27784af4be9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yTzPjVdr'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f7b1ea-ba9a-42ec-9ec5-5ab7c7a31935]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[df96af1e-6230-4df4-8c8c-cb99128763f6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4dd4e483-d392-4142-95b5-5bcf26aa7095 tempest-TaggedBootDevicesTest-848836101 tempest-TaggedBootDevicesTest-848836101-project-member] Lock "0c76033f-1eb7-4581-9e08-d262b4409c04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.718s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d56ac56-e0f6-4821-b5a7-c0b869d831cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7, portal: 172.16.0.220,3260]
Aug 17 08:22:42 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11f0e63-5e1b-4926-9a3b-66e844d7e6af]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d1029f-9cc8-4cba-a1a3-3910726950fd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:42 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:42 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:42 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:42 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1c7e26-b329-415f-b1ef-8b3ed2e328ae]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTzPjVdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:42 user nova-compute[72998]: WARNING nova.compute.manager [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 for instance with vm_state active and task_state deleting.
Aug 17 08:22:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-unplugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-unplugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-plugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] Acquiring lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] Lock "24f6cff0-793a-48ae-bd48-b276e9580897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] No waiting events found dispatching network-vif-plugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:42 user nova-compute[72998]: WARNING nova.compute.manager [req-c124b4be-07cd-4843-af90-ba61b4dbd973 req-4a064695-2709-413c-a2cf-270bab2acca0 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received unexpected event network-vif-plugged-0d4a0aba-073f-4cc5-9314-46f5e0b0468a for instance with vm_state active and task_state deleting.
Aug 17 08:22:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23161313935396362', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161313935396362', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1227355977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1227355977',id=15,image_ref='408413c7-90ba-4827-a322-8d3e6f4fd222',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-198637846',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:18:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-9031z9p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member',shelved_at='2023-08-17T08:20:28.798120',shelved_host='user',shelved_image_id='408413c7-90ba-4827-a322-8d3e6f4fd222'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.objects.instance [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:22:43 user nova-compute[72998]:   <uuid>9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66</uuid>
Aug 17 08:22:43 user nova-compute[72998]:   <name>instance-0000000f</name>
Aug 17 08:22:43 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:22:43 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:22:43 user nova-compute[72998]:   <metadata>
Aug 17 08:22:43 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:22:43 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:22:43 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1227355977</nova:name>
Aug 17 08:22:43 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:22:41</nova:creationTime>
Aug 17 08:22:43 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:22:43 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:22:43 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:22:43 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:22:43 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:22:43 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:22:43 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:22:43 user nova-compute[72998]:       <nova:owner>
Aug 17 08:22:43 user nova-compute[72998]:         <nova:user uuid="cf8febbec4ce4eb9a0132c51fae76de1">tempest-AttachVolumeShelveTestJSON-257833239-project-member</nova:user>
Aug 17 08:22:43 user nova-compute[72998]:         <nova:project uuid="846580b37b3545319d1897e07c828c59">tempest-AttachVolumeShelveTestJSON-257833239</nova:project>
Aug 17 08:22:43 user nova-compute[72998]:       </nova:owner>
Aug 17 08:22:43 user nova-compute[72998]:       <nova:root type="image" uuid="408413c7-90ba-4827-a322-8d3e6f4fd222"/>
Aug 17 08:22:43 user nova-compute[72998]:       <nova:ports>
Aug 17 08:22:43 user nova-compute[72998]:         <nova:port uuid="1177fb3c-1f8f-489c-ada6-748478daa64b">
Aug 17 08:22:43 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 08:22:43 user nova-compute[72998]:         </nova:port>
Aug 17 08:22:43 user nova-compute[72998]:       </nova:ports>
Aug 17 08:22:43 user nova-compute[72998]:     </nova:instance>
Aug 17 08:22:43 user nova-compute[72998]:   </metadata>
Aug 17 08:22:43 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:22:43 user nova-compute[72998]:     <system>
Aug 17 08:22:43 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:22:43 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:22:43 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:22:43 user nova-compute[72998]:       <entry name="serial">9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66</entry>
Aug 17 08:22:43 user nova-compute[72998]:       <entry name="uuid">9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66</entry>
Aug 17 08:22:43 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:22:43 user nova-compute[72998]:     </system>
Aug 17 08:22:43 user nova-compute[72998]:   </sysinfo>
Aug 17 08:22:43 user nova-compute[72998]:   <os>
Aug 17 08:22:43 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:22:43 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:22:43 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:22:43 user nova-compute[72998]:   </os>
Aug 17 08:22:43 user nova-compute[72998]:   <features>
Aug 17 08:22:43 user nova-compute[72998]:     <acpi/>
Aug 17 08:22:43 user nova-compute[72998]:     <apic/>
Aug 17 08:22:43 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:22:43 user nova-compute[72998]:   </features>
Aug 17 08:22:43 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:22:43 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:22:43 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:22:43 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:22:43 user nova-compute[72998]:   </clock>
Aug 17 08:22:43 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:22:43 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:22:43 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:22:43 user nova-compute[72998]:   </cpu>
Aug 17 08:22:43 user nova-compute[72998]:   <devices>
Aug 17 08:22:43 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:22:43 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:22:43 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk"/>
Aug 17 08:22:43 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:22:43 user nova-compute[72998]:     </disk>
Aug 17 08:22:43 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:22:43 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:22:43 user nova-compute[72998]:       <source dev="/dev/sdc"/>
Aug 17 08:22:43 user nova-compute[72998]:       <target dev="vdc" bus="virtio"/>
Aug 17 08:22:43 user nova-compute[72998]:       <serial>58a4a0a1-06ea-459f-b640-66890e7be1e7</serial>
Aug 17 08:22:43 user nova-compute[72998]:     </disk>
Aug 17 08:22:43 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:22:43 user nova-compute[72998]:       <mac address="fa:16:3e:a4:6c:80"/>
Aug 17 08:22:43 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:22:43 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:22:43 user nova-compute[72998]:       <target dev="tap1177fb3c-1f"/>
Aug 17 08:22:43 user nova-compute[72998]:     </interface>
Aug 17 08:22:43 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:22:43 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/console.log" append="off"/>
Aug 17 08:22:43 user nova-compute[72998]:     </serial>
Aug 17 08:22:43 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:22:43 user nova-compute[72998]:     <video>
Aug 17 08:22:43 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:22:43 user nova-compute[72998]:     </video>
Aug 17 08:22:43 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:22:43 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:22:43 user nova-compute[72998]:     </rng>
Aug 17 08:22:43 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:22:43 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:22:43 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:22:43 user nova-compute[72998]:     </memballoon>
Aug 17 08:22:43 user nova-compute[72998]:   </devices>
Aug 17 08:22:43 user nova-compute[72998]: </domain>
Aug 17 08:22:43 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1227355977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1227355977',id=15,image_ref='408413c7-90ba-4827-a322-8d3e6f4fd222',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-198637846',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:18:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-9031z9p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member',shelved_at='2023-08-17T08:20:28.798120',shelved_host='user',shelved_image_id='408413c7-90ba-4827-a322-8d3e6f4fd222'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG os_vif [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1177fb3c-1f, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1177fb3c-1f, col_values=(('external_ids', {'iface-id': '1177fb3c-1f8f-489c-ada6-748478daa64b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:6c:80', 'vm-uuid': '9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:43 user nova-compute[72998]: INFO os_vif [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f')
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260548.275785, 0c76033f-1eb7-4581-9e08-d262b4409c04 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:43 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] VM Stopped (Lifecycle Event)
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7967a0f4-0b2b-44a6-8951-4e94a5482d96 None None] [instance: 0c76033f-1eb7-4581-9e08-d262b4409c04] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:22:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] No VIF found with MAC fa:16:3e:a4:6c:80, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:22:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-91caa2d2-1587-4542-95e1-8e4083c4051f req-d0064b11-4c6f-4bd5-b369-20e1c9d705b1 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-deleted-af095d56-0fdd-44aa-bbd7-8dbc65a39804 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:44 user nova-compute[72998]: INFO nova.compute.manager [req-91caa2d2-1587-4542-95e1-8e4083c4051f req-d0064b11-4c6f-4bd5-b369-20e1c9d705b1 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Neutron deleted interface af095d56-0fdd-44aa-bbd7-8dbc65a39804; detaching it from the instance and deleting it from the info cache
Aug 17 08:22:44 user nova-compute[72998]: DEBUG nova.network.neutron [req-91caa2d2-1587-4542-95e1-8e4083c4051f req-d0064b11-4c6f-4bd5-b369-20e1c9d705b1 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [{"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "address": "fa:16:3e:6d:36:a9", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b95d72a-55", "ovs_interfaceid": "1b95d72a-55c1-4b66-8a9d-66c093e4c77a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-91caa2d2-1587-4542-95e1-8e4083c4051f req-d0064b11-4c6f-4bd5-b369-20e1c9d705b1 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Detach interface failed, port_id=af095d56-0fdd-44aa-bbd7-8dbc65a39804, reason: Instance 24f6cff0-793a-48ae-bd48-b276e9580897 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-07abfdab-ecab-4f35-a7da-feaef257f9a8 req-a26e25cb-1e97-47b8-a946-6660784d8c32 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-07abfdab-ecab-4f35-a7da-feaef257f9a8 req-a26e25cb-1e97-47b8-a946-6660784d8c32 service nova] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-07abfdab-ecab-4f35-a7da-feaef257f9a8 req-a26e25cb-1e97-47b8-a946-6660784d8c32 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-07abfdab-ecab-4f35-a7da-feaef257f9a8 req-a26e25cb-1e97-47b8-a946-6660784d8c32 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-07abfdab-ecab-4f35-a7da-feaef257f9a8 req-a26e25cb-1e97-47b8-a946-6660784d8c32 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] No waiting events found dispatching network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:45 user nova-compute[72998]: WARNING nova.compute.manager [req-07abfdab-ecab-4f35-a7da-feaef257f9a8 req-a26e25cb-1e97-47b8-a946-6660784d8c32 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received unexpected event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 08:22:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-deleted-1b95d72a-55c1-4b66-8a9d-66c093e4c77a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:46 user nova-compute[72998]: INFO nova.compute.manager [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Neutron deleted interface 1b95d72a-55c1-4b66-8a9d-66c093e4c77a; detaching it from the instance and deleting it from the info cache
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [{"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "address": "fa:16:3e:93:0c:bc", "network": {"id": "46d2c75f-cb8f-4fe3-bfd7-a433e937de9a", "bridge": "br-int", "label": "tempest-device-tagging-net2-938821864", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4a0aba-07", "ovs_interfaceid": "0d4a0aba-073f-4cc5-9314-46f5e0b0468a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Detach interface failed, port_id=1b95d72a-55c1-4b66-8a9d-66c093e4c77a, reason: Instance 24f6cff0-793a-48ae-bd48-b276e9580897 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-deleted-0d4a0aba-073f-4cc5-9314-46f5e0b0468a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:46 user nova-compute[72998]: INFO nova.compute.manager [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Neutron deleted interface 0d4a0aba-073f-4cc5-9314-46f5e0b0468a; detaching it from the instance and deleting it from the info cache
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [{"id": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "address": "fa:16:3e:8c:11:9f", "network": {"id": "8050f3d2-b71c-4064-888d-359e11222fbd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1095304968-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f7f651-70", "ovs_interfaceid": "f8f7f651-7001-4a2f-9a3f-845df27fb248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Detach interface failed, port_id=0d4a0aba-073f-4cc5-9314-46f5e0b0468a, reason: Instance 24f6cff0-793a-48ae-bd48-b276e9580897 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-deleted-f8f7f651-7001-4a2f-9a3f-845df27fb248 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:46 user nova-compute[72998]: INFO nova.compute.manager [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Neutron deleted interface f8f7f651-7001-4a2f-9a3f-845df27fb248; detaching it from the instance and deleting it from the info cache
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [{"id": "45f6182c-0023-4956-b6c9-69cf1980698c", "address": "fa:16:3e:7a:b3:44", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f6182c-00", "ovs_interfaceid": "45f6182c-0023-4956-b6c9-69cf1980698c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "address": "fa:16:3e:dc:4b:4e", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b6ef84-57", "ovs_interfaceid": "e7b6ef84-57ee-4d09-a074-2a379d73789e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "address": "fa:16:3e:86:ce:93", "network": {"id": "00eabec7-6ec3-49c8-b5df-e75276671908", "bridge": "br-int", "label": "tempest-device-tagging-net1-411521173", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83124dfa96344a56b27b2f89eeda1976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba954fc7-e9", "ovs_interfaceid": "ba954fc7-e9d4-42b5-b321-cd7269e42fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-02b7d5c5-6b41-4212-a7dc-109d02257513 req-4a5df634-1735-41fc-892b-5ef34f7bfe41 service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Detach interface failed, port_id=f8f7f651-7001-4a2f-9a3f-845df27fb248, reason: Instance 24f6cff0-793a-48ae-bd48-b276e9580897 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:46 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Took 5.18 seconds to deallocate network for instance.
Aug 17 08:22:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:22:47 user nova-compute[72998]: INFO nova.compute.claims [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Claim successful on node user
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-3abe7b81-49ae-4143-9108-db9f7422fec2 req-aa6aa547-6721-442f-bfba-27a815f88ad2 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3abe7b81-49ae-4143-9108-db9f7422fec2 req-aa6aa547-6721-442f-bfba-27a815f88ad2 service nova] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3abe7b81-49ae-4143-9108-db9f7422fec2 req-aa6aa547-6721-442f-bfba-27a815f88ad2 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3abe7b81-49ae-4143-9108-db9f7422fec2 req-aa6aa547-6721-442f-bfba-27a815f88ad2 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-3abe7b81-49ae-4143-9108-db9f7422fec2 req-aa6aa547-6721-442f-bfba-27a815f88ad2 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] No waiting events found dispatching network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:47 user nova-compute[72998]: WARNING nova.compute.manager [req-3abe7b81-49ae-4143-9108-db9f7422fec2 req-aa6aa547-6721-442f-bfba-27a815f88ad2 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received unexpected event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260567.4603956, 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] VM Resumed (Lifecycle Event)
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:22:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance spawned successfully.
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:22:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260567.461858, 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] VM Started (Lifecycle Event)
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:22:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.network.neutron [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:22:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.policy [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cf59502a7ee46968534c860fc9f49f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eaaef9c2492458bbe646bd227b11b64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:22:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Creating image(s)
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-551c68a0-9153-4857-b58b-7e4adb635efa tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 31.554s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.209s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.212s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk 1073741824" returned: 0 in 0.067s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG nova.network.neutron [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Successfully created port: 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-68fb8b1c-d3fd-42b5-acd2-459fc97a5055 req-54d7802f-8d07-41e4-b479-10ad5c3dc14d service nova] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Received event network-vif-deleted-ba954fc7-e9d4-42b5-b321-cd7269e42fb4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.243s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Cannot resize image /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG nova.objects.instance [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'migration_context' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Ensure instance console log exists: /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoGLHtNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:48 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:48 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:48 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f09fdd-bcc6-498c-b10c-89a1653baa96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:22:48 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea93114-ee88-4ccc-a1bc-cad51f802d4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9] added
Aug 17 08:22:48 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe725f5-7f4d-46d3-bb6e-30a58fd6ba61]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b58083-8597-4e63-8803-fb8a95391a5f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoGLHtNj {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoGLHtNj" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8607b37d-bed3-4b50-8e4e-1924669f4eb5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uoGLHtNj'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c306e83d-2c5b-440c-b7c6-3ead5ef719d9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef94547e-609d-4f25-80ed-feb0e2ccb4cd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:48 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:48 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:48 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:48 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:48 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:48 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f9152-c772-43fa-ae95-78fdbe55d67f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9, portal: 172.16.0.220,3260]
Aug 17 08:22:49 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e703866c-646f-4ce9-8017-bb507693caa5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76acb67-ab87-420d-b032-36d10199997e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:49 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:49 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:49 user nova-compute[72998]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 (non-flash)
Aug 17 08:22:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:49 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:49 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:49 user nova-compute[72998]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 (non-flash)
Aug 17 08:22:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2936225a-3533-414d-ba8d-d8871238323d]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoGLHtNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Successfully updated port: 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquired lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:22:49 user nova-compute[72998]: INFO nova.compute.manager [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Took 2.80 seconds to detach 3 volumes for instance.
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updating instance_info_cache with network_info: [{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Releasing lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Instance network_info: |[{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Start _get_guest_xml network_info=[{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:22:49 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:49 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-102578514',display_name='tempest-ServerRescueNegativeTestJSON-server-102578514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-102578514',id=20,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2Lu0G+dEKk1ITN6VCSNKHeyC2omToYMreON1EfAfUAlW7eydb0N9uRZDyYvmASKGFmKM32HQSYdDfvkNjLnd5zm68d/pHA9Ch82ZE/niVKWuR0qmU+M0OzlxTY5N53hA==',key_name='tempest-keypair-1851076836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-gyf5fjqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=8067a647-dca0-47d4-a472-eac43a2e4de6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2e:bb,bridge_name='br-int',has_traffic_filtering=True,id=8a57b8a0-b04f-4299-8344-e5c0f2b11bc6,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a57b8a0-b0') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.objects.instance [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'pci_devices' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:22:49 user nova-compute[72998]:   <uuid>8067a647-dca0-47d4-a472-eac43a2e4de6</uuid>
Aug 17 08:22:49 user nova-compute[72998]:   <name>instance-00000014</name>
Aug 17 08:22:49 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:22:49 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:22:49 user nova-compute[72998]:   <metadata>
Aug 17 08:22:49 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:22:49 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:22:49 user nova-compute[72998]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-102578514</nova:name>
Aug 17 08:22:49 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:22:49</nova:creationTime>
Aug 17 08:22:49 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:22:49 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:22:49 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:22:49 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:22:49 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:22:49 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:22:49 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:22:49 user nova-compute[72998]:       <nova:owner>
Aug 17 08:22:49 user nova-compute[72998]:         <nova:user uuid="4cf59502a7ee46968534c860fc9f49f5">tempest-ServerRescueNegativeTestJSON-826615417-project-member</nova:user>
Aug 17 08:22:49 user nova-compute[72998]:         <nova:project uuid="8eaaef9c2492458bbe646bd227b11b64">tempest-ServerRescueNegativeTestJSON-826615417</nova:project>
Aug 17 08:22:49 user nova-compute[72998]:       </nova:owner>
Aug 17 08:22:49 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:22:49 user nova-compute[72998]:       <nova:ports>
Aug 17 08:22:49 user nova-compute[72998]:         <nova:port uuid="8a57b8a0-b04f-4299-8344-e5c0f2b11bc6">
Aug 17 08:22:49 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 08:22:49 user nova-compute[72998]:         </nova:port>
Aug 17 08:22:49 user nova-compute[72998]:       </nova:ports>
Aug 17 08:22:49 user nova-compute[72998]:     </nova:instance>
Aug 17 08:22:49 user nova-compute[72998]:   </metadata>
Aug 17 08:22:49 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:22:49 user nova-compute[72998]:     <system>
Aug 17 08:22:49 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:22:49 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:22:49 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:22:49 user nova-compute[72998]:       <entry name="serial">8067a647-dca0-47d4-a472-eac43a2e4de6</entry>
Aug 17 08:22:49 user nova-compute[72998]:       <entry name="uuid">8067a647-dca0-47d4-a472-eac43a2e4de6</entry>
Aug 17 08:22:49 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:22:49 user nova-compute[72998]:     </system>
Aug 17 08:22:49 user nova-compute[72998]:   </sysinfo>
Aug 17 08:22:49 user nova-compute[72998]:   <os>
Aug 17 08:22:49 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:22:49 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:22:49 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:22:49 user nova-compute[72998]:   </os>
Aug 17 08:22:49 user nova-compute[72998]:   <features>
Aug 17 08:22:49 user nova-compute[72998]:     <acpi/>
Aug 17 08:22:49 user nova-compute[72998]:     <apic/>
Aug 17 08:22:49 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:22:49 user nova-compute[72998]:   </features>
Aug 17 08:22:49 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:22:49 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:22:49 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:22:49 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:22:49 user nova-compute[72998]:   </clock>
Aug 17 08:22:49 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:22:49 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:22:49 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:22:49 user nova-compute[72998]:   </cpu>
Aug 17 08:22:49 user nova-compute[72998]:   <devices>
Aug 17 08:22:49 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:22:49 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:22:49 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk"/>
Aug 17 08:22:49 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:22:49 user nova-compute[72998]:     </disk>
Aug 17 08:22:49 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:22:49 user nova-compute[72998]:       <mac address="fa:16:3e:37:2e:bb"/>
Aug 17 08:22:49 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:22:49 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:22:49 user nova-compute[72998]:       <target dev="tap8a57b8a0-b0"/>
Aug 17 08:22:49 user nova-compute[72998]:     </interface>
Aug 17 08:22:49 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:22:49 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/console.log" append="off"/>
Aug 17 08:22:49 user nova-compute[72998]:     </serial>
Aug 17 08:22:49 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:22:49 user nova-compute[72998]:     <video>
Aug 17 08:22:49 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:22:49 user nova-compute[72998]:     </video>
Aug 17 08:22:49 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:22:49 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:22:49 user nova-compute[72998]:     </rng>
Aug 17 08:22:49 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:22:49 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:22:49 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:22:49 user nova-compute[72998]:     </memballoon>
Aug 17 08:22:49 user nova-compute[72998]:   </devices>
Aug 17 08:22:49 user nova-compute[72998]: </domain>
Aug 17 08:22:49 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-102578514',display_name='tempest-ServerRescueNegativeTestJSON-server-102578514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-102578514',id=20,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2Lu0G+dEKk1ITN6VCSNKHeyC2omToYMreON1EfAfUAlW7eydb0N9uRZDyYvmASKGFmKM32HQSYdDfvkNjLnd5zm68d/pHA9Ch82ZE/niVKWuR0qmU+M0OzlxTY5N53hA==',key_name='tempest-keypair-1851076836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-gyf5fjqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=8067a647-dca0-47d4-a472-eac43a2e4de6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2e:bb,bridge_name='br-int',has_traffic_filtering=True,id=8a57b8a0-b04f-4299-8344-e5c0f2b11bc6,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a57b8a0-b0') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG os_vif [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2e:bb,bridge_name='br-int',has_traffic_filtering=True,id=8a57b8a0-b04f-4299-8344-e5c0f2b11bc6,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a57b8a0-b0') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a57b8a0-b0, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a57b8a0-b0, col_values=(('external_ids', {'iface-id': '8a57b8a0-b04f-4299-8344-e5c0f2b11bc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:2e:bb', 'vm-uuid': '8067a647-dca0-47d4-a472-eac43a2e4de6'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:22:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:50 user nova-compute[72998]: INFO os_vif [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2e:bb,bridge_name='br-int',has_traffic_filtering=True,id=8a57b8a0-b04f-4299-8344-e5c0f2b11bc6,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a57b8a0-b0')
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No VIF found with MAC fa:16:3e:37:2e:bb, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23966393532373634', 'path': '/dev/sdd'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966393532373634', 'path': '/dev/sdd'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.objects.instance [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'flavor' on Instance uuid 8ce248f4-ac65-4c06-81c0-d24816ad7f09 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:22:50 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:22:50 user nova-compute[72998]:   <source dev="/dev/sdd"/>
Aug 17 08:22:50 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:22:50 user nova-compute[72998]:   <serial>a3c65c6c-1c3f-4688-8039-2f415e214fa9</serial>
Aug 17 08:22:50 user nova-compute[72998]: </disk>
Aug 17 08:22:50 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:22:50 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Deleted allocations for instance 24f6cff0-793a-48ae-bd48-b276e9580897
Aug 17 08:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c857f89d-dd12-42ca-8c5f-25b592bf1f8b tempest-TaggedBootDevicesTest_v242-21992590 tempest-TaggedBootDevicesTest_v242-21992590-project-member] Lock "24f6cff0-793a-48ae-bd48-b276e9580897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.943s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-6ae21245-1888-4aa2-a66a-e31e636062cb req-7f4348c5-03e3-4866-aebc-7375593ace07 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-changed-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-6ae21245-1888-4aa2-a66a-e31e636062cb req-7f4348c5-03e3-4866-aebc-7375593ace07 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Refreshing instance network info cache due to event network-changed-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ae21245-1888-4aa2-a66a-e31e636062cb req-7f4348c5-03e3-4866-aebc-7375593ace07 service nova] Acquiring lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ae21245-1888-4aa2-a66a-e31e636062cb req-7f4348c5-03e3-4866-aebc-7375593ace07 service nova] Acquired lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:22:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-6ae21245-1888-4aa2-a66a-e31e636062cb req-7f4348c5-03e3-4866-aebc-7375593ace07 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Refreshing network info cache for port 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] No VIF found with MAC fa:16:3e:6f:70:54, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG nova.network.neutron [req-6ae21245-1888-4aa2-a66a-e31e636062cb req-7f4348c5-03e3-4866-aebc-7375593ace07 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updated VIF entry in instance network info cache for port 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG nova.network.neutron [req-6ae21245-1888-4aa2-a66a-e31e636062cb req-7f4348c5-03e3-4866-aebc-7375593ace07 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updating instance_info_cache with network_info: [{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ae21245-1888-4aa2-a66a-e31e636062cb req-7f4348c5-03e3-4866-aebc-7375593ace07 service nova] Releasing lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bcd4f729-96f4-46dc-a7dd-34f5db5f21b1 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.930s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-c41a1c3c-e1f0-42a7-bd26-d599f6cd24dc req-4311e0a1-eb3a-4326-8055-adfd4a44a323 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c41a1c3c-e1f0-42a7-bd26-d599f6cd24dc req-4311e0a1-eb3a-4326-8055-adfd4a44a323 service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c41a1c3c-e1f0-42a7-bd26-d599f6cd24dc req-4311e0a1-eb3a-4326-8055-adfd4a44a323 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c41a1c3c-e1f0-42a7-bd26-d599f6cd24dc req-4311e0a1-eb3a-4326-8055-adfd4a44a323 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-c41a1c3c-e1f0-42a7-bd26-d599f6cd24dc req-4311e0a1-eb3a-4326-8055-adfd4a44a323 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:52 user nova-compute[72998]: WARNING nova.compute.manager [req-c41a1c3c-e1f0-42a7-bd26-d599f6cd24dc req-4311e0a1-eb3a-4326-8055-adfd4a44a323 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state building and task_state spawning.
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:53 user nova-compute[72998]: INFO nova.compute.manager [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Detaching volume c86f548e-92a7-4a7c-ac4e-fa659c203ad3
Aug 17 08:22:53 user nova-compute[72998]: INFO nova.virt.block_device [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Attempting to driver detach volume c86f548e-92a7-4a7c-ac4e-fa659c203ad3 from mountpoint /dev/vdb
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Attempting to detach device vdb from instance f79a3323-477f-4689-b8e3-35f2ff59a641 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:22:53 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:22:53 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:22:53 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:22:53 user nova-compute[72998]:   <serial>c86f548e-92a7-4a7c-ac4e-fa659c203ad3</serial>
Aug 17 08:22:53 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 08:22:53 user nova-compute[72998]: </disk>
Aug 17 08:22:53 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:22:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully detached device vdb from instance f79a3323-477f-4689-b8e3-35f2ff59a641 from the persistent domain config.
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f79a3323-477f-4689-b8e3-35f2ff59a641 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:22:53 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:22:53 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:22:53 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:22:53 user nova-compute[72998]:   <serial>c86f548e-92a7-4a7c-ac4e-fa659c203ad3</serial>
Aug 17 08:22:53 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 08:22:53 user nova-compute[72998]: </disk>
Aug 17 08:22:53 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260573.7788844, f79a3323-477f-4689-b8e3-35f2ff59a641 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:22:53 user nova-compute[72998]: INFO nova.compute.manager [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Detaching volume a3c65c6c-1c3f-4688-8039-2f415e214fa9
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:22:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully detached device vdb from instance f79a3323-477f-4689-b8e3-35f2ff59a641 from the live domain config.
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtRFOwAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:53 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2003d-a37b-428e-9a88-d61d629eeab3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:53 user nova-compute[72998]: INFO nova.virt.block_device [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Attempting to driver detach volume a3c65c6c-1c3f-4688-8039-2f415e214fa9 from mountpoint /dev/vdb
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9270c0df-e5a3-4857-8e7b-7a9cddd06e6b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:53 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:53 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:53 user nova-compute[72998]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 (non-flash)
Aug 17 08:22:53 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 (non-flash)
Aug 17 08:22:53 user nova-compute[72998]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:53 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:53 user nova-compute[72998]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 (non-flash)
Aug 17 08:22:53 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4b78c6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Attempting to detach device vdb from instance 8ce248f4-ac65-4c06-81c0-d24816ad7f09 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:22:53 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:22:53 user nova-compute[72998]:   <source dev="/dev/sdd"/>
Aug 17 08:22:53 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:22:53 user nova-compute[72998]:   <serial>a3c65c6c-1c3f-4688-8039-2f415e214fa9</serial>
Aug 17 08:22:53 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:22:53 user nova-compute[72998]: </disk>
Aug 17 08:22:53 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4afad9-1fbf-4286-bb03-0800d4df17db]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Successfully detached device vdb from instance 8ce248f4-ac65-4c06-81c0-d24816ad7f09 from the persistent domain config.
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ce248f4-ac65-4c06-81c0-d24816ad7f09 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:22:53 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:22:53 user nova-compute[72998]:   <source dev="/dev/sdd"/>
Aug 17 08:22:53 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:22:53 user nova-compute[72998]:   <serial>a3c65c6c-1c3f-4688-8039-2f415e214fa9</serial>
Aug 17 08:22:53 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:22:53 user nova-compute[72998]: </disk>
Aug 17 08:22:53 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9050c0-e5f7-4c56-9c3a-b9df742a7e41]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[541f4799-7032-4099-9dd1-3c68d7814ff1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16620f6-17d9-4309-b8ca-cab200b27368]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:22:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd1c431-47ba-4711-a930-4bae5cff2b58]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0413f98-c1f9-4bd1-ba60-8e01d51d440e]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260]
Aug 17 08:22:54 user nova-compute[72998]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:54 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-a2a1a20f-aa1d-406a-877f-b4ccb2de1541 req-69a2e086-be4c-4229-aaec-695d4ebed14e service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a2a1a20f-aa1d-406a-877f-b4ccb2de1541 req-69a2e086-be4c-4229-aaec-695d4ebed14e service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a2a1a20f-aa1d-406a-877f-b4ccb2de1541 req-69a2e086-be4c-4229-aaec-695d4ebed14e service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a2a1a20f-aa1d-406a-877f-b4ccb2de1541 req-69a2e086-be4c-4229-aaec-695d4ebed14e service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-a2a1a20f-aa1d-406a-877f-b4ccb2de1541 req-69a2e086-be4c-4229-aaec-695d4ebed14e service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:22:54 user nova-compute[72998]: WARNING nova.compute.manager [req-a2a1a20f-aa1d-406a-877f-b4ccb2de1541 req-69a2e086-be4c-4229-aaec-695d4ebed14e service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state building and task_state spawning.
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86f548e-92a7-4a7c-ac4e-fa659c203ad3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[62361c57-d8a3-4727-8d56-af6dad4052b8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== disconnect_volume: return (325ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260574.1841114, 8067a647-dca0-47d4-a472-eac43a2e4de6 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] VM Resumed (Lifecycle Event)
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:22:54 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Instance spawned successfully.
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:22:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260574.1854372, 8067a647-dca0-47d4-a472-eac43a2e4de6 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] VM Started (Lifecycle Event)
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:22:54 user nova-compute[72998]: INFO nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260574.3756227, 8ce248f4-ac65-4c06-81c0-d24816ad7f09 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ce248f4-ac65-4c06-81c0-d24816ad7f09 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:22:54 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Successfully detached device vdb from instance 8ce248f4-ac65-4c06-81c0-d24816ad7f09 from the live domain config.
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoGLHtNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:22:54 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd931d7b-0f84-4764-bd8d-f5c6e3a43ec8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: INFO nova.compute.manager [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Took 7.41 seconds to build instance.
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-14533fa5-f72e-45ee-99c0-47ba13c3271e tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.514s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b43ab7-08ee-4655-8403-be80fcafb432]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:54 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:54 user nova-compute[72998]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 (non-flash)
Aug 17 08:22:54 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:22:54 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:22:54 user nova-compute[72998]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 (non-flash)
Aug 17 08:22:54 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4885a7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9'): ({'sdd'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Removing single pathed devices sdd {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8accb0c7-cdb9-46fa-a6eb-0fbd91ed9ecf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260559.4841607, 24f6cff0-793a-48ae-bd48-b276e9580897 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:22:54 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] VM Stopped (Lifecycle Event)
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[feda9b98-0652-4655-8f3d-e0aade54599c]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Flushing IO for device /dev/sdd {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-c100cbaf-a2c9-4fd2-8708-82a3cb55b633 None None] [instance: 24f6cff0-793a-48ae-bd48-b276e9580897] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4c0b3e-89c1-4e18-b1db-ee1710697450]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e558cc91-f0f9-41f5-9a53-4b0967d83b2f]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8350707-1d46-4817-9b52-78ad33acf8b3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf56957-e066-45e2-bdaf-0d31064ce1ce]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9, portal: 172.16.0.220,3260]
Aug 17 08:22:54 user nova-compute[72998]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9, portal: 172.16.0.220,3260] successful.
Aug 17 08:22:54 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c65c6c-1c3f-4688-8039-2f415e214fa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7493f5-c96e-430f-97c3-fcafca322a97]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] <== disconnect_volume: return (331ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:22:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'flavor' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae904bc6-bf45-4526-a5cb-9369e3a9b205 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.957s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:22:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'flavor' on Instance uuid 8ce248f4-ac65-4c06-81c0-d24816ad7f09 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-384bfe37-b7e1-42db-87aa-89e27a3066e5 tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.814s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:22:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:23:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:23:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:23:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:23:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:23:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updating instance_info_cache with network_info: [{"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:23:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:23:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:23:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:23:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:23:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:04 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:23:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:23:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:23:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:10 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:23:10 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7379MB free_disk=24.118751525878906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cfbd3131-e61b-45a4-8c69-91081320f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 794e686e-2e6a-42f5-b817-5d18d2ad705e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance f79a3323-477f-4689-b8e3-35f2ff59a641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8ce248f4-ac65-4c06-81c0-d24816ad7f09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8067a647-dca0-47d4-a472-eac43a2e4de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:23:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:23:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:23:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:23:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:23:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:23:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:23:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:23:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:23:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:23:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:23:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:23:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:23:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:43 user nova-compute[72998]: INFO nova.compute.manager [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Terminating instance
Aug 17 08:23:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-f0eac517-fb51-4aa5-b9ed-75a1ca0a941c req-d397f05a-761e-4d11-8bf8-d60e66a8a3b2 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-unplugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f0eac517-fb51-4aa5-b9ed-75a1ca0a941c req-d397f05a-761e-4d11-8bf8-d60e66a8a3b2 service nova] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f0eac517-fb51-4aa5-b9ed-75a1ca0a941c req-d397f05a-761e-4d11-8bf8-d60e66a8a3b2 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f0eac517-fb51-4aa5-b9ed-75a1ca0a941c req-d397f05a-761e-4d11-8bf8-d60e66a8a3b2 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-f0eac517-fb51-4aa5-b9ed-75a1ca0a941c req-d397f05a-761e-4d11-8bf8-d60e66a8a3b2 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] No waiting events found dispatching network-vif-unplugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-f0eac517-fb51-4aa5-b9ed-75a1ca0a941c req-d397f05a-761e-4d11-8bf8-d60e66a8a3b2 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-unplugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:44 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Instance destroyed successfully.
Aug 17 08:23:44 user nova-compute[72998]: DEBUG nova.objects.instance [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'resources' on Instance uuid f79a3323-477f-4689-b8e3-35f2ff59a641 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:23:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-649770025',display_name='tempest-ServerActionsTestOtherA-server-21228523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-649770025',id=13,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkgz6KIvkjo7YISoQuK0gKb5worGqa3M96YDdoFGvE2t+BrFcgavSDbwPCbWbcUEBpB4d8lGQtJpxdLC26DtEQzWbxv/vhiZjqnt3G/kF8kNKY2c+leCXryY3xsQnrvtA==',key_name='tempest-keypair-1697256322',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-lz1l9ivg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=f79a3323-477f-4689-b8e3-35f2ff59a641,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:23:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "address": "fa:16:3e:aa:80:db", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cbeff07-8a", "ovs_interfaceid": "8cbeff07-8a68-46c9-92b4-58f4f07fb208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:23:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:23:44 user nova-compute[72998]: DEBUG os_vif [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:23:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cbeff07-8a, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:23:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:23:44 user nova-compute[72998]: INFO os_vif [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:80:db,bridge_name='br-int',has_traffic_filtering=True,id=8cbeff07-8a68-46c9-92b4-58f4f07fb208,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cbeff07-8a')
Aug 17 08:23:44 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Deleting instance files /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641_del
Aug 17 08:23:44 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Deletion of /opt/stack/data/nova/instances/f79a3323-477f-4689-b8e3-35f2ff59a641_del complete
Aug 17 08:23:44 user nova-compute[72998]: INFO nova.compute.manager [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 17 08:23:44 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:23:44 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:23:44 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-e32da155-075d-4fc6-b21a-3e5393244d3a req-1b35c7cf-a944-43be-8d20-4e622a9ba858 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received event network-changed-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-e32da155-075d-4fc6-b21a-3e5393244d3a req-1b35c7cf-a944-43be-8d20-4e622a9ba858 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Refreshing instance network info cache due to event network-changed-9400f947-e6bc-41f9-8b42-9e68740ec3d5. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e32da155-075d-4fc6-b21a-3e5393244d3a req-1b35c7cf-a944-43be-8d20-4e622a9ba858 service nova] Acquiring lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e32da155-075d-4fc6-b21a-3e5393244d3a req-1b35c7cf-a944-43be-8d20-4e622a9ba858 service nova] Acquired lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG nova.network.neutron [req-e32da155-075d-4fc6-b21a-3e5393244d3a req-1b35c7cf-a944-43be-8d20-4e622a9ba858 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Refreshing network info cache for port 9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:45 user nova-compute[72998]: INFO nova.compute.manager [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Terminating instance
Aug 17 08:23:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-76f834fb-5cfb-48f8-8a00-4d6456b380a9 req-7e29955f-8c81-4af8-8a95-336e0f25e0d8 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-76f834fb-5cfb-48f8-8a00-4d6456b380a9 req-7e29955f-8c81-4af8-8a95-336e0f25e0d8 service nova] Acquiring lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-76f834fb-5cfb-48f8-8a00-4d6456b380a9 req-7e29955f-8c81-4af8-8a95-336e0f25e0d8 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-76f834fb-5cfb-48f8-8a00-4d6456b380a9 req-7e29955f-8c81-4af8-8a95-336e0f25e0d8 service nova] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-76f834fb-5cfb-48f8-8a00-4d6456b380a9 req-7e29955f-8c81-4af8-8a95-336e0f25e0d8 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] No waiting events found dispatching network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:23:45 user nova-compute[72998]: WARNING nova.compute.manager [req-76f834fb-5cfb-48f8-8a00-4d6456b380a9 req-7e29955f-8c81-4af8-8a95-336e0f25e0d8 service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received unexpected event network-vif-plugged-8cbeff07-8a68-46c9-92b4-58f4f07fb208 for instance with vm_state active and task_state deleting.
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-e32da155-075d-4fc6-b21a-3e5393244d3a req-1b35c7cf-a944-43be-8d20-4e622a9ba858 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Updated VIF entry in instance network info cache for port 9400f947-e6bc-41f9-8b42-9e68740ec3d5. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.network.neutron [req-e32da155-075d-4fc6-b21a-3e5393244d3a req-1b35c7cf-a944-43be-8d20-4e622a9ba858 service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Updating instance_info_cache with network_info: [{"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e32da155-075d-4fc6-b21a-3e5393244d3a req-1b35c7cf-a944-43be-8d20-4e622a9ba858 service nova] Releasing lock "refresh_cache-8ce248f4-ac65-4c06-81c0-d24816ad7f09" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:23:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Instance destroyed successfully.
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'resources' on Instance uuid 8ce248f4-ac65-4c06-81c0-d24816ad7f09 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1739831247',display_name='tempest-TestStampPattern-server-1739831247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1739831247',id=18,image_ref='262dff16-5489-46bf-80fb-c261115e81c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONZnqz4fz+N+JdDC9+VNVpRQxh6Mlne8ooU/TM1lcGerNueG6YDdZwYx4ZrGiVscocoQaLxw+uf1ndX7MqRoz/Bmg7lB1XGzA+NMiG3jzsbCxCIyBAvUWgKK/6+2DK/Eg==',key_name='tempest-TestStampPattern-1214740701',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74f95e7d214049b3831b038a0f0c4d8c',ramdisk_id='',reservation_id='r-8xbpg1iw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='cfbd3131-e61b-45a4-8c69-91081320f046',image_min_disk='1',image_min_ram='0',image_owner_id='74f95e7d214049b3831b038a0f0c4d8c',image_owner_project_name='tempest-TestStampPattern-795414078',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-795414078-project-member',image_user_id='39227b3a71d243a3acafa9317a45e691',owner_project_name='tempest-TestStampPattern-795414078',owner_user_name='tempest-TestStampPattern-795414078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:50Z,user_data=None,user_id='39227b3a71d243a3acafa9317a45e691',uuid=8ce248f4-ac65-4c06-81c0-d24816ad7f09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converting VIF {"id": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "address": "fa:16:3e:6f:70:54", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9400f947-e6", "ovs_interfaceid": "9400f947-e6bc-41f9-8b42-9e68740ec3d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:70:54,bridge_name='br-int',has_traffic_filtering=True,id=9400f947-e6bc-41f9-8b42-9e68740ec3d5,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9400f947-e6') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG os_vif [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:70:54,bridge_name='br-int',has_traffic_filtering=True,id=9400f947-e6bc-41f9-8b42-9e68740ec3d5,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9400f947-e6') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9400f947-e6, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:23:46 user nova-compute[72998]: INFO os_vif [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:70:54,bridge_name='br-int',has_traffic_filtering=True,id=9400f947-e6bc-41f9-8b42-9e68740ec3d5,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9400f947-e6')
Aug 17 08:23:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Deleting instance files /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09_del
Aug 17 08:23:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Deletion of /opt/stack/data/nova/instances/8ce248f4-ac65-4c06-81c0-d24816ad7f09_del complete
Aug 17 08:23:46 user nova-compute[72998]: INFO nova.compute.manager [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 17 08:23:46 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:23:46 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Took 2.20 seconds to deallocate network for instance.
Aug 17 08:23:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:23:46 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Took 0.65 seconds to deallocate network for instance.
Aug 17 08:23:46 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.027s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:47 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Deleted allocations for instance f79a3323-477f-4689-b8e3-35f2ff59a641
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ffb5e092-90c5-4495-842d-eca696740510 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "f79a3323-477f-4689-b8e3-35f2ff59a641" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.683s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received event network-vif-unplugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] No waiting events found dispatching network-vif-unplugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:23:47 user nova-compute[72998]: WARNING nova.compute.manager [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received unexpected event network-vif-unplugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 for instance with vm_state deleted and task_state None.
Aug 17 08:23:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Received event network-vif-deleted-8cbeff07-8a68-46c9-92b4-58f4f07fb208 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received event network-vif-plugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] Acquiring lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] No waiting events found dispatching network-vif-plugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:23:47 user nova-compute[72998]: WARNING nova.compute.manager [req-6ad74720-ed90-43bd-bc2b-c56af4da9397 req-52176333-015b-4bff-b070-d30fe539445e service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received unexpected event network-vif-plugged-9400f947-e6bc-41f9-8b42-9e68740ec3d5 for instance with vm_state deleted and task_state None.
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:47 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Deleted allocations for instance 8ce248f4-ac65-4c06-81c0-d24816ad7f09
Aug 17 08:23:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c4ad516a-db85-48df-8b53-347ab76f7c5c tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "8ce248f4-ac65-4c06-81c0-d24816ad7f09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-8863a139-9382-47d4-96ba-34ef9bc5fd82 req-efb8fcbf-a2af-4774-8cb0-123da00e0bff service nova] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Received event network-vif-deleted-9400f947-e6bc-41f9-8b42-9e68740ec3d5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:51 user nova-compute[72998]: INFO nova.compute.manager [None req-ae86cb5c-5a50-4939-a175-e82ae275d2a6 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Unrescuing
Aug 17 08:23:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae86cb5c-5a50-4939-a175-e82ae275d2a6 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:23:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae86cb5c-5a50-4939-a175-e82ae275d2a6 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquired lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:23:51 user nova-compute[72998]: DEBUG nova.network.neutron [None req-ae86cb5c-5a50-4939-a175-e82ae275d2a6 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-ae86cb5c-5a50-4939-a175-e82ae275d2a6 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating instance_info_cache with network_info: [{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ae86cb5c-5a50-4939-a175-e82ae275d2a6 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Releasing lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG nova.objects.instance [None req-ae86cb5c-5a50-4939-a175-e82ae275d2a6 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'flavor' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-315d6e94-d1e1-478e-9e9a-dcb1e79c57b1 req-518ce0ef-7ca8-441f-90ca-171d15f03ab3 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-unplugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-315d6e94-d1e1-478e-9e9a-dcb1e79c57b1 req-518ce0ef-7ca8-441f-90ca-171d15f03ab3 service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-315d6e94-d1e1-478e-9e9a-dcb1e79c57b1 req-518ce0ef-7ca8-441f-90ca-171d15f03ab3 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-315d6e94-d1e1-478e-9e9a-dcb1e79c57b1 req-518ce0ef-7ca8-441f-90ca-171d15f03ab3 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-315d6e94-d1e1-478e-9e9a-dcb1e79c57b1 req-518ce0ef-7ca8-441f-90ca-171d15f03ab3 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-unplugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:23:52 user nova-compute[72998]: WARNING nova.compute.manager [req-315d6e94-d1e1-478e-9e9a-dcb1e79c57b1 req-518ce0ef-7ca8-441f-90ca-171d15f03ab3 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-unplugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:23:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Instance destroyed successfully.
Aug 17 08:23:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-6abde464-a34f-4392-894c-7867eba77e41 req-2efb690d-acc8-40b7-8519-0885744f9171 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-changed-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-6abde464-a34f-4392-894c-7867eba77e41 req-2efb690d-acc8-40b7-8519-0885744f9171 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Refreshing instance network info cache due to event network-changed-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6abde464-a34f-4392-894c-7867eba77e41 req-2efb690d-acc8-40b7-8519-0885744f9171 service nova] Acquiring lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6abde464-a34f-4392-894c-7867eba77e41 req-2efb690d-acc8-40b7-8519-0885744f9171 service nova] Acquired lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-6abde464-a34f-4392-894c-7867eba77e41 req-2efb690d-acc8-40b7-8519-0885744f9171 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Refreshing network info cache for port 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-6abde464-a34f-4392-894c-7867eba77e41 req-2efb690d-acc8-40b7-8519-0885744f9171 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updated VIF entry in instance network info cache for port 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-6abde464-a34f-4392-894c-7867eba77e41 req-2efb690d-acc8-40b7-8519-0885744f9171 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating instance_info_cache with network_info: [{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6abde464-a34f-4392-894c-7867eba77e41 req-2efb690d-acc8-40b7-8519-0885744f9171 service nova] Releasing lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6974625-58be-4ac0-b600-548948739d96 req-43b4f928-604d-4908-b197-7d5a63b9abf6 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6974625-58be-4ac0-b600-548948739d96 req-43b4f928-604d-4908-b197-7d5a63b9abf6 service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6974625-58be-4ac0-b600-548948739d96 req-43b4f928-604d-4908-b197-7d5a63b9abf6 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6974625-58be-4ac0-b600-548948739d96 req-43b4f928-604d-4908-b197-7d5a63b9abf6 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6974625-58be-4ac0-b600-548948739d96 req-43b4f928-604d-4908-b197-7d5a63b9abf6 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:23:54 user nova-compute[72998]: WARNING nova.compute.manager [req-f6974625-58be-4ac0-b600-548948739d96 req-43b4f928-604d-4908-b197-7d5a63b9abf6 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:23:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-01befe29-c436-461d-a96a-042014d67844 req-5dbcae03-4672-4617-9d7d-81c47353dc12 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-changed-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-01befe29-c436-461d-a96a-042014d67844 req-5dbcae03-4672-4617-9d7d-81c47353dc12 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Refreshing instance network info cache due to event network-changed-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-01befe29-c436-461d-a96a-042014d67844 req-5dbcae03-4672-4617-9d7d-81c47353dc12 service nova] Acquiring lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-01befe29-c436-461d-a96a-042014d67844 req-5dbcae03-4672-4617-9d7d-81c47353dc12 service nova] Acquired lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-01befe29-c436-461d-a96a-042014d67844 req-5dbcae03-4672-4617-9d7d-81c47353dc12 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Refreshing network info cache for port 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-01befe29-c436-461d-a96a-042014d67844 req-5dbcae03-4672-4617-9d7d-81c47353dc12 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updated VIF entry in instance network info cache for port 4f14bfc7-3d2d-4f6f-ad48-80946cac3cef. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-01befe29-c436-461d-a96a-042014d67844 req-5dbcae03-4672-4617-9d7d-81c47353dc12 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating instance_info_cache with network_info: [{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-01befe29-c436-461d-a96a-042014d67844 req-5dbcae03-4672-4617-9d7d-81c47353dc12 service nova] Releasing lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for 794e686e-2e6a-42f5-b817-5d18d2ad705e due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260636.7745771, 794e686e-2e6a-42f5-b817-5d18d2ad705e => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:23:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] VM Resumed (Lifecycle Event)
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ae86cb5c-5a50-4939-a175-e82ae275d2a6 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:23:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260636.7774756, 794e686e-2e6a-42f5-b817-5d18d2ad705e => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:23:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] VM Started (Lifecycle Event)
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:23:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:23:57 user nova-compute[72998]: WARNING nova.compute.manager [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state active and task_state None.
Aug 17 08:23:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:23:57 user nova-compute[72998]: WARNING nova.compute.manager [req-f9d36f2d-187e-41fb-a4ef-2d1465fb79ed req-9bc53d8f-cd7e-48d1-abef-f942306329a4 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state active and task_state None.
Aug 17 08:23:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:23:59 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260624.2827027, f79a3323-477f-4689-b8e3-35f2ff59a641 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:23:59 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] VM Stopped (Lifecycle Event)
Aug 17 08:23:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-88bbeec6-7226-4569-a38c-effa7a62e5b0 None None] [instance: f79a3323-477f-4689-b8e3-35f2ff59a641] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:01 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260626.1994078, 8ce248f4-ac65-4c06-81c0-d24816ad7f09 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:24:01 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] VM Stopped (Lifecycle Event)
Aug 17 08:24:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-05a551f6-cc6a-45fd-8f8b-14522e104ec2 None None] [instance: 8ce248f4-ac65-4c06-81c0-d24816ad7f09] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:24:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:24:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:03 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating instance_info_cache with network_info: [{"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-794e686e-2e6a-42f5-b817-5d18d2ad705e" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:24:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:24:04 user nova-compute[72998]: INFO nova.compute.claims [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Claim successful on node user
Aug 17 08:24:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.314s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.network.neutron [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:24:05 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.policy [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cbf4e4b883f484980af4bde95f8fd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f94111e9fa4659a975f8478d7ca7da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:24:05 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Creating image(s)
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "/opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "/opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "/opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.211s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.207s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk 1073741824" returned: 0 in 0.066s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.195s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.network.neutron [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Successfully created port: e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Cannot resize image /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.objects.instance [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'migration_context' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Ensure instance console log exists: /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:06 user nova-compute[72998]: INFO nova.compute.manager [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Detaching volume 58a4a0a1-06ea-459f-b640-66890e7be1e7
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:06 user nova-compute[72998]: INFO nova.virt.block_device [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Attempting to driver detach volume 58a4a0a1-06ea-459f-b640-66890e7be1e7 from mountpoint /dev/vdc
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Attempting to detach device vdc from instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:24:06 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:24:06 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:24:06 user nova-compute[72998]:   <target dev="vdc" bus="virtio"/>
Aug 17 08:24:06 user nova-compute[72998]:   <serial>58a4a0a1-06ea-459f-b640-66890e7be1e7</serial>
Aug 17 08:24:06 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 08:24:06 user nova-compute[72998]: </disk>
Aug 17 08:24:06 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:24:06 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully detached device vdc from instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 from the persistent domain config.
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:24:06 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:24:06 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:24:06 user nova-compute[72998]:   <target dev="vdc" bus="virtio"/>
Aug 17 08:24:06 user nova-compute[72998]:   <serial>58a4a0a1-06ea-459f-b640-66890e7be1e7</serial>
Aug 17 08:24:06 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 08:24:06 user nova-compute[72998]: </disk>
Aug 17 08:24:06 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260647.1337385, 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:24:07 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully detached device vdc from instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 from the live domain config.
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTzPjVdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:24:07 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8c7d5c-3d0c-42ab-92ab-928ff8d3c52b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e28d332-63d3-4952-8631-959e0cdd9c18]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:24:07 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:24:07 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:24:07 user nova-compute[72998]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 (non-flash)
Aug 17 08:24:07 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4b79d6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cb4247-54ef-4976-83a0-cac60bf2835b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d67bf-2237-4bd6-a148-796c9b926269]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caa485c-a963-4f74-88b4-9bcd3ddf9b10]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[96064cd0-78f4-4048-b088-a9a78b1b0a36]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[991396c7-ac4f-4899-8667-f7d29ae55360]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a09b881-5172-4bed-b990-f9bccc354b65]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7, portal: 172.16.0.220,3260]
Aug 17 08:24:07 user nova-compute[72998]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7, portal: 172.16.0.220,3260] successful.
Aug 17 08:24:07 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58a4a0a1-06ea-459f-b640-66890e7be1e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[686b9077-2ea8-4119-9923-23cef8a264d6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] <== disconnect_volume: return (337ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Successfully updated port: e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquired lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.compute.manager [req-2f60693e-7b48-45c8-b52a-f7e061d087c5 req-49776462-1cd2-45d7-be62-6486cfe3de16 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-changed-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.compute.manager [req-2f60693e-7b48-45c8-b52a-f7e061d087c5 req-49776462-1cd2-45d7-be62-6486cfe3de16 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Refreshing instance network info cache due to event network-changed-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2f60693e-7b48-45c8-b52a-f7e061d087c5 req-49776462-1cd2-45d7-be62-6486cfe3de16 service nova] Acquiring lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Releasing lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance network_info: |[{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2f60693e-7b48-45c8-b52a-f7e061d087c5 req-49776462-1cd2-45d7-be62-6486cfe3de16 service nova] Acquired lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-2f60693e-7b48-45c8-b52a-f7e061d087c5 req-49776462-1cd2-45d7-be62-6486cfe3de16 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Refreshing network info cache for port e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Start _get_guest_xml network_info=[{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:24:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1893379751',display_name='tempest-ServerActionsTestOtherB-server-1893379751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1893379751',id=21,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1sywPS7noB6enRkafRCV4V8gUajrQp1IvyFeTNyX5oNNHzp72oZWl7JWE9EVMF5YzyYJVOw45540lSzJ/aE8AmU535jNS6dcszNW9Kp6/r+UbKETYBcWkdMqhnsqo26g==',key_name='tempest-keypair-2137913041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90f94111e9fa4659a975f8478d7ca7da',ramdisk_id='',reservation_id='r-t6pdxe0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1997511094',owner_user_name='tempest-ServerActionsTestOtherB-1997511094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cbf4e4b883f484980af4bde95f8fd88',uuid=4119f28a-b9f1-4996-a144-68edd4f08c44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converting VIF {"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.objects.instance [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'pci_devices' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:24:08 user nova-compute[72998]:   <uuid>4119f28a-b9f1-4996-a144-68edd4f08c44</uuid>
Aug 17 08:24:08 user nova-compute[72998]:   <name>instance-00000015</name>
Aug 17 08:24:08 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:24:08 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:24:08 user nova-compute[72998]:   <metadata>
Aug 17 08:24:08 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:24:08 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:24:08 user nova-compute[72998]:       <nova:name>tempest-ServerActionsTestOtherB-server-1893379751</nova:name>
Aug 17 08:24:08 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:24:08</nova:creationTime>
Aug 17 08:24:08 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:24:08 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:24:08 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:24:08 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:24:08 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:24:08 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:24:08 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:24:08 user nova-compute[72998]:       <nova:owner>
Aug 17 08:24:08 user nova-compute[72998]:         <nova:user uuid="9cbf4e4b883f484980af4bde95f8fd88">tempest-ServerActionsTestOtherB-1997511094-project-member</nova:user>
Aug 17 08:24:08 user nova-compute[72998]:         <nova:project uuid="90f94111e9fa4659a975f8478d7ca7da">tempest-ServerActionsTestOtherB-1997511094</nova:project>
Aug 17 08:24:08 user nova-compute[72998]:       </nova:owner>
Aug 17 08:24:08 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:24:08 user nova-compute[72998]:       <nova:ports>
Aug 17 08:24:08 user nova-compute[72998]:         <nova:port uuid="e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3">
Aug 17 08:24:08 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 08:24:08 user nova-compute[72998]:         </nova:port>
Aug 17 08:24:08 user nova-compute[72998]:       </nova:ports>
Aug 17 08:24:08 user nova-compute[72998]:     </nova:instance>
Aug 17 08:24:08 user nova-compute[72998]:   </metadata>
Aug 17 08:24:08 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:24:08 user nova-compute[72998]:     <system>
Aug 17 08:24:08 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:24:08 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:24:08 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:24:08 user nova-compute[72998]:       <entry name="serial">4119f28a-b9f1-4996-a144-68edd4f08c44</entry>
Aug 17 08:24:08 user nova-compute[72998]:       <entry name="uuid">4119f28a-b9f1-4996-a144-68edd4f08c44</entry>
Aug 17 08:24:08 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:24:08 user nova-compute[72998]:     </system>
Aug 17 08:24:08 user nova-compute[72998]:   </sysinfo>
Aug 17 08:24:08 user nova-compute[72998]:   <os>
Aug 17 08:24:08 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:24:08 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:24:08 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:24:08 user nova-compute[72998]:   </os>
Aug 17 08:24:08 user nova-compute[72998]:   <features>
Aug 17 08:24:08 user nova-compute[72998]:     <acpi/>
Aug 17 08:24:08 user nova-compute[72998]:     <apic/>
Aug 17 08:24:08 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:24:08 user nova-compute[72998]:   </features>
Aug 17 08:24:08 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:24:08 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:24:08 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:24:08 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:24:08 user nova-compute[72998]:   </clock>
Aug 17 08:24:08 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:24:08 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:24:08 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:24:08 user nova-compute[72998]:   </cpu>
Aug 17 08:24:08 user nova-compute[72998]:   <devices>
Aug 17 08:24:08 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:24:08 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:24:08 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk"/>
Aug 17 08:24:08 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:24:08 user nova-compute[72998]:     </disk>
Aug 17 08:24:08 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:24:08 user nova-compute[72998]:       <mac address="fa:16:3e:36:9d:90"/>
Aug 17 08:24:08 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:24:08 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:24:08 user nova-compute[72998]:       <target dev="tape9cd3f5a-80"/>
Aug 17 08:24:08 user nova-compute[72998]:     </interface>
Aug 17 08:24:08 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:24:08 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/console.log" append="off"/>
Aug 17 08:24:08 user nova-compute[72998]:     </serial>
Aug 17 08:24:08 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:24:08 user nova-compute[72998]:     <video>
Aug 17 08:24:08 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:24:08 user nova-compute[72998]:     </video>
Aug 17 08:24:08 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:24:08 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:24:08 user nova-compute[72998]:     </rng>
Aug 17 08:24:08 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:24:08 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:24:08 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:24:08 user nova-compute[72998]:     </memballoon>
Aug 17 08:24:08 user nova-compute[72998]:   </devices>
Aug 17 08:24:08 user nova-compute[72998]: </domain>
Aug 17 08:24:08 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1893379751',display_name='tempest-ServerActionsTestOtherB-server-1893379751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1893379751',id=21,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1sywPS7noB6enRkafRCV4V8gUajrQp1IvyFeTNyX5oNNHzp72oZWl7JWE9EVMF5YzyYJVOw45540lSzJ/aE8AmU535jNS6dcszNW9Kp6/r+UbKETYBcWkdMqhnsqo26g==',key_name='tempest-keypair-2137913041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90f94111e9fa4659a975f8478d7ca7da',ramdisk_id='',reservation_id='r-t6pdxe0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1997511094',owner_user_name='tempest-ServerActionsTestOtherB-1997511094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cbf4e4b883f484980af4bde95f8fd88',uuid=4119f28a-b9f1-4996-a144-68edd4f08c44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converting VIF {"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG os_vif [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9cd3f5a-80, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9cd3f5a-80, col_values=(('external_ids', {'iface-id': 'e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:9d:90', 'vm-uuid': '4119f28a-b9f1-4996-a144-68edd4f08c44'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:08 user nova-compute[72998]: INFO os_vif [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80')
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] No VIF found with MAC fa:16:3e:36:9d:90, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.objects.instance [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'flavor' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-2f60693e-7b48-45c8-b52a-f7e061d087c5 req-49776462-1cd2-45d7-be62-6486cfe3de16 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updated VIF entry in instance network info cache for port e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-2f60693e-7b48-45c8-b52a-f7e061d087c5 req-49776462-1cd2-45d7-be62-6486cfe3de16 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2f60693e-7b48-45c8-b52a-f7e061d087c5 req-49776462-1cd2-45d7-be62-6486cfe3de16 service nova] Releasing lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-209decba-237f-488d-aed1-da3240898cdf tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.136s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:09 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:09 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7696MB free_disk=24.107112884521484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cfbd3131-e61b-45a4-8c69-91081320f046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 794e686e-2e6a-42f5-b817-5d18d2ad705e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8067a647-dca0-47d4-a472-eac43a2e4de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:24:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:24:10 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:24:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:24:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:24:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:11 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260651.977208, 4119f28a-b9f1-4996-a144-68edd4f08c44 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:24:11 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] VM Resumed (Lifecycle Event)
Aug 17 08:24:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:24:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:24:11 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance spawned successfully.
Aug 17 08:24:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:12 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260651.9798295, 4119f28a-b9f1-4996-a144-68edd4f08c44 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:24:12 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] VM Started (Lifecycle Event)
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:24:12 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:24:12 user nova-compute[72998]: INFO nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Took 6.70 seconds to spawn the instance on the hypervisor.
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:12 user nova-compute[72998]: INFO nova.compute.manager [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Took 7.46 seconds to build instance.
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dcc2a03b-2c79-425c-b021-6fbe4f89bbef tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.570s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-03173055-4d85-4353-95b5-916e7df64a94 req-78cd2fc6-c961-4a99-bcbf-46c5ed860fb7 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-03173055-4d85-4353-95b5-916e7df64a94 req-78cd2fc6-c961-4a99-bcbf-46c5ed860fb7 service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-03173055-4d85-4353-95b5-916e7df64a94 req-78cd2fc6-c961-4a99-bcbf-46c5ed860fb7 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-03173055-4d85-4353-95b5-916e7df64a94 req-78cd2fc6-c961-4a99-bcbf-46c5ed860fb7 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-03173055-4d85-4353-95b5-916e7df64a94 req-78cd2fc6-c961-4a99-bcbf-46c5ed860fb7 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:12 user nova-compute[72998]: WARNING nova.compute.manager [req-03173055-4d85-4353-95b5-916e7df64a94 req-78cd2fc6-c961-4a99-bcbf-46c5ed860fb7 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state None.
Aug 17 08:24:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-c72f8b00-5ad0-423e-9dea-a85803c9318c req-37d803c0-1a00-4959-93ea-10ab22dfe83c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c72f8b00-5ad0-423e-9dea-a85803c9318c req-37d803c0-1a00-4959-93ea-10ab22dfe83c service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c72f8b00-5ad0-423e-9dea-a85803c9318c req-37d803c0-1a00-4959-93ea-10ab22dfe83c service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c72f8b00-5ad0-423e-9dea-a85803c9318c req-37d803c0-1a00-4959-93ea-10ab22dfe83c service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-c72f8b00-5ad0-423e-9dea-a85803c9318c req-37d803c0-1a00-4959-93ea-10ab22dfe83c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:14 user nova-compute[72998]: WARNING nova.compute.manager [req-c72f8b00-5ad0-423e-9dea-a85803c9318c req-37d803c0-1a00-4959-93ea-10ab22dfe83c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state None.
Aug 17 08:24:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:17 user nova-compute[72998]: INFO nova.compute.manager [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] instance snapshotting
Aug 17 08:24:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Beginning live snapshot process
Aug 17 08:24:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json -f qcow2 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json -f qcow2" returned: 0 in 0.294s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json -f qcow2 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json -f qcow2" returned: 0 in 0.244s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:24:17 user nova-compute[72998]: INFO nova.compute.claims [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Claim successful on node user
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.212s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcx_7xzln/41a5627a06fb4b3e9fcd3acc3513a601.delta 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcx_7xzln/41a5627a06fb4b3e9fcd3acc3513a601.delta 1073741824" returned: 0 in 0.063s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:18 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 08:24:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:24:18 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.policy [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dedd991048b34559acc5465faf521198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77012255394ad0bab402375507d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:24:18 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Creating image(s)
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "/opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "/opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "/opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.187s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.228s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk 1073741824" returned: 0 in 0.061s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:24:19 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 08:24:19 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Successfully created port: 85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.261s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcx_7xzln/41a5627a06fb4b3e9fcd3acc3513a601.delta /opt/stack/data/nova/instances/snapshots/tmpcx_7xzln/41a5627a06fb4b3e9fcd3acc3513a601 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Cannot resize image /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'migration_context' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Ensure instance console log exists: /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcx_7xzln/41a5627a06fb4b3e9fcd3acc3513a601.delta /opt/stack/data/nova/instances/snapshots/tmpcx_7xzln/41a5627a06fb4b3e9fcd3acc3513a601" returned: 0 in 0.671s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:20 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Snapshot extracted, beginning image upload
Aug 17 08:24:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Successfully updated port: 85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquired lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-8534bfd0-8f64-40f0-87a1-c93b5b10184f req-c81a7a44-50d2-44b2-ae7a-a143a1e47d54 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-changed-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-8534bfd0-8f64-40f0-87a1-c93b5b10184f req-c81a7a44-50d2-44b2-ae7a-a143a1e47d54 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Refreshing instance network info cache due to event network-changed-85901016-fa8e-4d52-9229-caa63c02bea3. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8534bfd0-8f64-40f0-87a1-c93b5b10184f req-c81a7a44-50d2-44b2-ae7a-a143a1e47d54 service nova] Acquiring lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updating instance_info_cache with network_info: [{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Releasing lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance network_info: |[{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8534bfd0-8f64-40f0-87a1-c93b5b10184f req-c81a7a44-50d2-44b2-ae7a-a143a1e47d54 service nova] Acquired lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.network.neutron [req-8534bfd0-8f64-40f0-87a1-c93b5b10184f req-c81a7a44-50d2-44b2-ae7a-a143a1e47d54 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Refreshing network info cache for port 85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Start _get_guest_xml network_info=[{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:24:21 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:21 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1003522619',display_name='tempest-AttachVolumeTestJSON-server-1003522619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1003522619',id=22,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmc8qbkgbu95dJvwY1bo5kn9RJpsYoyrns3+CWvhffMSTP6KyY1SbvmOYfexUjDzD3737D3c8fhHlVWQh2nyWElT5uU1HwkwSVrOW/xi1hx6Ymm9am4ZS8Qy8EFRomqnw==',key_name='tempest-keypair-346425477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-h31cebic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=87850ffb-dfa9-4b23-bd18-938744cd9b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'pci_devices' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:24:21 user nova-compute[72998]:   <uuid>87850ffb-dfa9-4b23-bd18-938744cd9b5f</uuid>
Aug 17 08:24:21 user nova-compute[72998]:   <name>instance-00000016</name>
Aug 17 08:24:21 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:24:21 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:24:21 user nova-compute[72998]:   <metadata>
Aug 17 08:24:21 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:24:21 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:24:21 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeTestJSON-server-1003522619</nova:name>
Aug 17 08:24:21 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:24:21</nova:creationTime>
Aug 17 08:24:21 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:24:21 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:24:21 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:24:21 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:24:21 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:24:21 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:24:21 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:24:21 user nova-compute[72998]:       <nova:owner>
Aug 17 08:24:21 user nova-compute[72998]:         <nova:user uuid="dedd991048b34559acc5465faf521198">tempest-AttachVolumeTestJSON-1538733103-project-member</nova:user>
Aug 17 08:24:21 user nova-compute[72998]:         <nova:project uuid="be77012255394ad0bab402375507d6ef">tempest-AttachVolumeTestJSON-1538733103</nova:project>
Aug 17 08:24:21 user nova-compute[72998]:       </nova:owner>
Aug 17 08:24:21 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:24:21 user nova-compute[72998]:       <nova:ports>
Aug 17 08:24:21 user nova-compute[72998]:         <nova:port uuid="85901016-fa8e-4d52-9229-caa63c02bea3">
Aug 17 08:24:21 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 08:24:21 user nova-compute[72998]:         </nova:port>
Aug 17 08:24:21 user nova-compute[72998]:       </nova:ports>
Aug 17 08:24:21 user nova-compute[72998]:     </nova:instance>
Aug 17 08:24:21 user nova-compute[72998]:   </metadata>
Aug 17 08:24:21 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:24:21 user nova-compute[72998]:     <system>
Aug 17 08:24:21 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:24:21 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:24:21 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:24:21 user nova-compute[72998]:       <entry name="serial">87850ffb-dfa9-4b23-bd18-938744cd9b5f</entry>
Aug 17 08:24:21 user nova-compute[72998]:       <entry name="uuid">87850ffb-dfa9-4b23-bd18-938744cd9b5f</entry>
Aug 17 08:24:21 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:24:21 user nova-compute[72998]:     </system>
Aug 17 08:24:21 user nova-compute[72998]:   </sysinfo>
Aug 17 08:24:21 user nova-compute[72998]:   <os>
Aug 17 08:24:21 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:24:21 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:24:21 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:24:21 user nova-compute[72998]:   </os>
Aug 17 08:24:21 user nova-compute[72998]:   <features>
Aug 17 08:24:21 user nova-compute[72998]:     <acpi/>
Aug 17 08:24:21 user nova-compute[72998]:     <apic/>
Aug 17 08:24:21 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:24:21 user nova-compute[72998]:   </features>
Aug 17 08:24:21 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:24:21 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:24:21 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:24:21 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:24:21 user nova-compute[72998]:   </clock>
Aug 17 08:24:21 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:24:21 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:24:21 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:24:21 user nova-compute[72998]:   </cpu>
Aug 17 08:24:21 user nova-compute[72998]:   <devices>
Aug 17 08:24:21 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:24:21 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:24:21 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk"/>
Aug 17 08:24:21 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:24:21 user nova-compute[72998]:     </disk>
Aug 17 08:24:21 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:24:21 user nova-compute[72998]:       <mac address="fa:16:3e:9c:31:a6"/>
Aug 17 08:24:21 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:24:21 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:24:21 user nova-compute[72998]:       <target dev="tap85901016-fa"/>
Aug 17 08:24:21 user nova-compute[72998]:     </interface>
Aug 17 08:24:21 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:24:21 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/console.log" append="off"/>
Aug 17 08:24:21 user nova-compute[72998]:     </serial>
Aug 17 08:24:21 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:24:21 user nova-compute[72998]:     <video>
Aug 17 08:24:21 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:24:21 user nova-compute[72998]:     </video>
Aug 17 08:24:21 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:24:21 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:24:21 user nova-compute[72998]:     </rng>
Aug 17 08:24:21 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:24:21 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:24:21 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:24:21 user nova-compute[72998]:     </memballoon>
Aug 17 08:24:21 user nova-compute[72998]:   </devices>
Aug 17 08:24:21 user nova-compute[72998]: </domain>
Aug 17 08:24:21 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1003522619',display_name='tempest-AttachVolumeTestJSON-server-1003522619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1003522619',id=22,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmc8qbkgbu95dJvwY1bo5kn9RJpsYoyrns3+CWvhffMSTP6KyY1SbvmOYfexUjDzD3737D3c8fhHlVWQh2nyWElT5uU1HwkwSVrOW/xi1hx6Ymm9am4ZS8Qy8EFRomqnw==',key_name='tempest-keypair-346425477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-h31cebic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=87850ffb-dfa9-4b23-bd18-938744cd9b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG os_vif [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85901016-fa, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85901016-fa, col_values=(('external_ids', {'iface-id': '85901016-fa8e-4d52-9229-caa63c02bea3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:31:a6', 'vm-uuid': '87850ffb-dfa9-4b23-bd18-938744cd9b5f'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:21 user nova-compute[72998]: INFO os_vif [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa')
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No VIF found with MAC fa:16:3e:9c:31:a6, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:24:21 user nova-compute[72998]: INFO nova.compute.claims [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Claim successful on node user
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.network.neutron [req-8534bfd0-8f64-40f0-87a1-c93b5b10184f req-c81a7a44-50d2-44b2-ae7a-a143a1e47d54 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updated VIF entry in instance network info cache for port 85901016-fa8e-4d52-9229-caa63c02bea3. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.network.neutron [req-8534bfd0-8f64-40f0-87a1-c93b5b10184f req-c81a7a44-50d2-44b2-ae7a-a143a1e47d54 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updating instance_info_cache with network_info: [{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8534bfd0-8f64-40f0-87a1-c93b5b10184f req-c81a7a44-50d2-44b2-ae7a-a143a1e47d54 service nova] Releasing lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:24:22 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.policy [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '963659ce0d9c4e04bf345d4a98080e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6c1ee7c1e04088ae7a3e952743576c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:24:22 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Creating image(s)
Aug 17 08:24:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "/opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "/opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.204s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:23 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Snapshot image upload complete
Aug 17 08:24:23 user nova-compute[72998]: INFO nova.compute.manager [None req-1f4f502e-7dee-4189-8b1d-d21d9955e149 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Took 6.35 seconds to snapshot the instance on the hypervisor.
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.273s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk 1073741824" returned: 0 in 0.084s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-fed242f7-7338-40b5-82ad-38c430b4d892 req-1b01a283-d047-4434-92ea-4f55f1fc94fe service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fed242f7-7338-40b5-82ad-38c430b4d892 req-1b01a283-d047-4434-92ea-4f55f1fc94fe service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fed242f7-7338-40b5-82ad-38c430b4d892 req-1b01a283-d047-4434-92ea-4f55f1fc94fe service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fed242f7-7338-40b5-82ad-38c430b4d892 req-1b01a283-d047-4434-92ea-4f55f1fc94fe service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-fed242f7-7338-40b5-82ad-38c430b4d892 req-1b01a283-d047-4434-92ea-4f55f1fc94fe service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:23 user nova-compute[72998]: WARNING nova.compute.manager [req-fed242f7-7338-40b5-82ad-38c430b4d892 req-1b01a283-d047-4434-92ea-4f55f1fc94fe service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state building and task_state spawning.
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Successfully created port: c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Cannot resize image /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'migration_context' on Instance uuid 8b55bd93-be1c-4b78-ab1a-adba05d5efde {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Ensure instance console log exists: /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:24 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Successfully updated port: c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:24:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "refresh_cache-8b55bd93-be1c-4b78-ab1a-adba05d5efde" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquired lock "refresh_cache-8b55bd93-be1c-4b78-ab1a-adba05d5efde" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:24 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:24:24 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Updating instance_info_cache with network_info: [{"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Releasing lock "refresh_cache-8b55bd93-be1c-4b78-ab1a-adba05d5efde" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Instance network_info: |[{"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Start _get_guest_xml network_info=[{"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:24:25 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:25 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1657475901',display_name='tempest-VolumesSnapshotTestJSON-instance-1657475901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1657475901',id=23,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBU1NTP3xE2ieGrCcVMXPgypdK/lAEvWQphigZAWkHBKwbND/EXft4MkV4wfzpv3LK/9amRRGwVgp5HXAZ2LxONP7ytJFOAfPSy8L5oSDyRMS7Pf3N2RRwPbuSsUttpziA==',key_name='tempest-keypair-145777980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c1ee7c1e04088ae7a3e952743576c',ramdisk_id='',reservation_id='r-9t48mn6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-20738309',owner_user_name='tempest-VolumesSnapshotTestJSON-20738309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='963659ce0d9c4e04bf345d4a98080e89',uuid=8b55bd93-be1c-4b78-ab1a-adba05d5efde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converting VIF {"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9f:5b,bridge_name='br-int',has_traffic_filtering=True,id=c1f346f0-ef4e-4cee-82b3-fe22060c58fb,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f346f0-ef') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b55bd93-be1c-4b78-ab1a-adba05d5efde {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:24:25 user nova-compute[72998]:   <uuid>8b55bd93-be1c-4b78-ab1a-adba05d5efde</uuid>
Aug 17 08:24:25 user nova-compute[72998]:   <name>instance-00000017</name>
Aug 17 08:24:25 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:24:25 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:24:25 user nova-compute[72998]:   <metadata>
Aug 17 08:24:25 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:24:25 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:24:25 user nova-compute[72998]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1657475901</nova:name>
Aug 17 08:24:25 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:24:25</nova:creationTime>
Aug 17 08:24:25 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:24:25 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:24:25 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:24:25 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:24:25 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:24:25 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:24:25 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:24:25 user nova-compute[72998]:       <nova:owner>
Aug 17 08:24:25 user nova-compute[72998]:         <nova:user uuid="963659ce0d9c4e04bf345d4a98080e89">tempest-VolumesSnapshotTestJSON-20738309-project-member</nova:user>
Aug 17 08:24:25 user nova-compute[72998]:         <nova:project uuid="8f6c1ee7c1e04088ae7a3e952743576c">tempest-VolumesSnapshotTestJSON-20738309</nova:project>
Aug 17 08:24:25 user nova-compute[72998]:       </nova:owner>
Aug 17 08:24:25 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:24:25 user nova-compute[72998]:       <nova:ports>
Aug 17 08:24:25 user nova-compute[72998]:         <nova:port uuid="c1f346f0-ef4e-4cee-82b3-fe22060c58fb">
Aug 17 08:24:25 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 08:24:25 user nova-compute[72998]:         </nova:port>
Aug 17 08:24:25 user nova-compute[72998]:       </nova:ports>
Aug 17 08:24:25 user nova-compute[72998]:     </nova:instance>
Aug 17 08:24:25 user nova-compute[72998]:   </metadata>
Aug 17 08:24:25 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:24:25 user nova-compute[72998]:     <system>
Aug 17 08:24:25 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:24:25 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:24:25 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:24:25 user nova-compute[72998]:       <entry name="serial">8b55bd93-be1c-4b78-ab1a-adba05d5efde</entry>
Aug 17 08:24:25 user nova-compute[72998]:       <entry name="uuid">8b55bd93-be1c-4b78-ab1a-adba05d5efde</entry>
Aug 17 08:24:25 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:24:25 user nova-compute[72998]:     </system>
Aug 17 08:24:25 user nova-compute[72998]:   </sysinfo>
Aug 17 08:24:25 user nova-compute[72998]:   <os>
Aug 17 08:24:25 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:24:25 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:24:25 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:24:25 user nova-compute[72998]:   </os>
Aug 17 08:24:25 user nova-compute[72998]:   <features>
Aug 17 08:24:25 user nova-compute[72998]:     <acpi/>
Aug 17 08:24:25 user nova-compute[72998]:     <apic/>
Aug 17 08:24:25 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:24:25 user nova-compute[72998]:   </features>
Aug 17 08:24:25 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:24:25 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:24:25 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:24:25 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:24:25 user nova-compute[72998]:   </clock>
Aug 17 08:24:25 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:24:25 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:24:25 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:24:25 user nova-compute[72998]:   </cpu>
Aug 17 08:24:25 user nova-compute[72998]:   <devices>
Aug 17 08:24:25 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:24:25 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:24:25 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk"/>
Aug 17 08:24:25 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:24:25 user nova-compute[72998]:     </disk>
Aug 17 08:24:25 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:24:25 user nova-compute[72998]:       <mac address="fa:16:3e:98:9f:5b"/>
Aug 17 08:24:25 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:24:25 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:24:25 user nova-compute[72998]:       <target dev="tapc1f346f0-ef"/>
Aug 17 08:24:25 user nova-compute[72998]:     </interface>
Aug 17 08:24:25 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:24:25 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/console.log" append="off"/>
Aug 17 08:24:25 user nova-compute[72998]:     </serial>
Aug 17 08:24:25 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:24:25 user nova-compute[72998]:     <video>
Aug 17 08:24:25 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:24:25 user nova-compute[72998]:     </video>
Aug 17 08:24:25 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:24:25 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:24:25 user nova-compute[72998]:     </rng>
Aug 17 08:24:25 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:24:25 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:24:25 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:24:25 user nova-compute[72998]:     </memballoon>
Aug 17 08:24:25 user nova-compute[72998]:   </devices>
Aug 17 08:24:25 user nova-compute[72998]: </domain>
Aug 17 08:24:25 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1657475901',display_name='tempest-VolumesSnapshotTestJSON-instance-1657475901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1657475901',id=23,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBU1NTP3xE2ieGrCcVMXPgypdK/lAEvWQphigZAWkHBKwbND/EXft4MkV4wfzpv3LK/9amRRGwVgp5HXAZ2LxONP7ytJFOAfPSy8L5oSDyRMS7Pf3N2RRwPbuSsUttpziA==',key_name='tempest-keypair-145777980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c1ee7c1e04088ae7a3e952743576c',ramdisk_id='',reservation_id='r-9t48mn6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-20738309',owner_user_name='tempest-VolumesSnapshotTestJSON-20738309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='963659ce0d9c4e04bf345d4a98080e89',uuid=8b55bd93-be1c-4b78-ab1a-adba05d5efde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converting VIF {"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9f:5b,bridge_name='br-int',has_traffic_filtering=True,id=c1f346f0-ef4e-4cee-82b3-fe22060c58fb,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f346f0-ef') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG os_vif [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9f:5b,bridge_name='br-int',has_traffic_filtering=True,id=c1f346f0-ef4e-4cee-82b3-fe22060c58fb,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f346f0-ef') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1f346f0-ef, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1f346f0-ef, col_values=(('external_ids', {'iface-id': 'c1f346f0-ef4e-4cee-82b3-fe22060c58fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:9f:5b', 'vm-uuid': '8b55bd93-be1c-4b78-ab1a-adba05d5efde'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:25 user nova-compute[72998]: INFO os_vif [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9f:5b,bridge_name='br-int',has_traffic_filtering=True,id=c1f346f0-ef4e-4cee-82b3-fe22060c58fb,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f346f0-ef')
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No VIF found with MAC fa:16:3e:98:9f:5b, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260665.496193, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:24:25 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] VM Resumed (Lifecycle Event)
Aug 17 08:24:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance spawned successfully.
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:25 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260665.496472, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:24:25 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] VM Started (Lifecycle Event)
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:24:25 user nova-compute[72998]: INFO nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:25 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:25 user nova-compute[72998]: WARNING nova.compute.manager [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state building and task_state spawning.
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received event network-changed-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Refreshing instance network info cache due to event network-changed-c1f346f0-ef4e-4cee-82b3-fe22060c58fb. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] Acquiring lock "refresh_cache-8b55bd93-be1c-4b78-ab1a-adba05d5efde" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] Acquired lock "refresh_cache-8b55bd93-be1c-4b78-ab1a-adba05d5efde" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG nova.network.neutron [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Refreshing network info cache for port c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:24:25 user nova-compute[72998]: INFO nova.compute.manager [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Took 7.90 seconds to build instance.
Aug 17 08:24:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6d65f473-f271-49c8-b4a5-fe8835ac86f3 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.251s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Updated VIF entry in instance network info cache for port c1f346f0-ef4e-4cee-82b3-fe22060c58fb. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Updating instance_info_cache with network_info: [{"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f5987b52-d645-42e6-8d0d-8f85f3245aa1 req-5fa7f55e-2acb-436a-a7cd-9c346edfd0bc service nova] Releasing lock "refresh_cache-8b55bd93-be1c-4b78-ab1a-adba05d5efde" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:26 user nova-compute[72998]: INFO nova.compute.manager [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Detaching volume 840d5785-2771-4304-bb85-08e411ebc715
Aug 17 08:24:26 user nova-compute[72998]: INFO nova.virt.block_device [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Attempting to driver detach volume 840d5785-2771-4304-bb85-08e411ebc715 from mountpoint /dev/vdb
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Attempting to detach device vdb from instance 794e686e-2e6a-42f5-b817-5d18d2ad705e from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:24:26 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:24:26 user nova-compute[72998]:   <source dev="/dev/sdi"/>
Aug 17 08:24:26 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:24:26 user nova-compute[72998]:   <serial>840d5785-2771-4304-bb85-08e411ebc715</serial>
Aug 17 08:24:26 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:24:26 user nova-compute[72998]: </disk>
Aug 17 08:24:26 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:24:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Successfully detached device vdb from instance 794e686e-2e6a-42f5-b817-5d18d2ad705e from the persistent domain config.
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 794e686e-2e6a-42f5-b817-5d18d2ad705e from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:24:26 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:24:26 user nova-compute[72998]:   <source dev="/dev/sdi"/>
Aug 17 08:24:26 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:24:26 user nova-compute[72998]:   <serial>840d5785-2771-4304-bb85-08e411ebc715</serial>
Aug 17 08:24:26 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:24:26 user nova-compute[72998]: </disk>
Aug 17 08:24:26 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-f95095bd-0bf5-4a6a-abb2-476c0e2b860c req-46fb2192-adc5-47e3-aa04-91713b802755 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received event network-vif-plugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f95095bd-0bf5-4a6a-abb2-476c0e2b860c req-46fb2192-adc5-47e3-aa04-91713b802755 service nova] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f95095bd-0bf5-4a6a-abb2-476c0e2b860c req-46fb2192-adc5-47e3-aa04-91713b802755 service nova] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f95095bd-0bf5-4a6a-abb2-476c0e2b860c req-46fb2192-adc5-47e3-aa04-91713b802755 service nova] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-f95095bd-0bf5-4a6a-abb2-476c0e2b860c req-46fb2192-adc5-47e3-aa04-91713b802755 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] No waiting events found dispatching network-vif-plugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:26 user nova-compute[72998]: WARNING nova.compute.manager [req-f95095bd-0bf5-4a6a-abb2-476c0e2b860c req-46fb2192-adc5-47e3-aa04-91713b802755 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received unexpected event network-vif-plugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb for instance with vm_state building and task_state spawning.
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260666.97051, 794e686e-2e6a-42f5-b817-5d18d2ad705e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:24:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Successfully detached device vdb from instance 794e686e-2e6a-42f5-b817-5d18d2ad705e from the live domain config.
Aug 17 08:24:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpRuPHnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:24:26 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:24:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:24:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d995b2-5d05-4127-8b0d-d5dcac6c9109]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b97981-b2e6-461a-ba3a-bb182f92a1f0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:24:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 (non-flash)
Aug 17 08:24:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4884d7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715'): ({'sdi'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Removing single pathed devices sdi {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fee782-6aca-401a-b9e9-2363f96d8387]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c450bbb-af94-4eac-afa2-ecb28e952ac7]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Flushing IO for device /dev/sdi {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb455d1-02af-415e-b77e-ae73c74f2450]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe30015-a776-49a1-a929-056f2f4c5aff]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] SCSI volumes sdi have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead0cddf-5a31-40d5-96e1-89efafbbe7ae]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[886c93bc-931e-4d44-a09d-d58f725072c6]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715, portal: 172.16.0.220,3260]
Aug 17 08:24:27 user nova-compute[72998]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715, portal: 172.16.0.220,3260] successful.
Aug 17 08:24:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840d5785-2771-4304-bb85-08e411ebc715 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5cabc0-b006-4a19-9410-d58a7e95272d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] <== disconnect_volume: return (303ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'flavor' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-120b5b32-cf39-480e-a352-a83f544f79b8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.021s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-457d7889-2455-4cf8-96e5-322b1eb132bb req-94313429-c20b-4f07-bc99-56f28e161974 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received event network-vif-plugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-457d7889-2455-4cf8-96e5-322b1eb132bb req-94313429-c20b-4f07-bc99-56f28e161974 service nova] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-457d7889-2455-4cf8-96e5-322b1eb132bb req-94313429-c20b-4f07-bc99-56f28e161974 service nova] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-457d7889-2455-4cf8-96e5-322b1eb132bb req-94313429-c20b-4f07-bc99-56f28e161974 service nova] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-457d7889-2455-4cf8-96e5-322b1eb132bb req-94313429-c20b-4f07-bc99-56f28e161974 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] No waiting events found dispatching network-vif-plugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:28 user nova-compute[72998]: WARNING nova.compute.manager [req-457d7889-2455-4cf8-96e5-322b1eb132bb req-94313429-c20b-4f07-bc99-56f28e161974 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received unexpected event network-vif-plugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb for instance with vm_state building and task_state spawning.
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260669.5745754, 8b55bd93-be1c-4b78-ab1a-adba05d5efde => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:24:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] VM Resumed (Lifecycle Event)
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:24:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Instance spawned successfully.
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:24:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260669.5754995, 8b55bd93-be1c-4b78-ab1a-adba05d5efde => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:24:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] VM Started (Lifecycle Event)
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:24:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:24:29 user nova-compute[72998]: INFO nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 17 08:24:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:29 user nova-compute[72998]: INFO nova.compute.manager [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Took 7.82 seconds to build instance.
Aug 17 08:24:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d525974-0cbe-4509-9e7a-56e504eac937 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.927s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-ab63b492-92a2-4f3c-be5c-53f45c06c28b req-028e1e51-d239-48da-9879-29b8f8979268 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-changed-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-ab63b492-92a2-4f3c-be5c-53f45c06c28b req-028e1e51-d239-48da-9879-29b8f8979268 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Refreshing instance network info cache due to event network-changed-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:24:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ab63b492-92a2-4f3c-be5c-53f45c06c28b req-028e1e51-d239-48da-9879-29b8f8979268 service nova] Acquiring lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ab63b492-92a2-4f3c-be5c-53f45c06c28b req-028e1e51-d239-48da-9879-29b8f8979268 service nova] Acquired lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-ab63b492-92a2-4f3c-be5c-53f45c06c28b req-028e1e51-d239-48da-9879-29b8f8979268 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Refreshing network info cache for port 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG nova.objects.instance [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'flavor' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:38 user nova-compute[72998]: INFO nova.compute.manager [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Attaching volume 84a0c0ad-efde-4cea-83d6-9dc42122bcba to /dev/vdb
Aug 17 08:24:38 user nova-compute[72998]: DEBUG os_brick.utils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG nova.network.neutron [req-ab63b492-92a2-4f3c-be5c-53f45c06c28b req-028e1e51-d239-48da-9879-29b8f8979268 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updated VIF entry in instance network info cache for port 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG nova.network.neutron [req-ab63b492-92a2-4f3c-be5c-53f45c06c28b req-028e1e51-d239-48da-9879-29b8f8979268 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updating instance_info_cache with network_info: [{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d117f06-eb63-4a7a-ab6b-c79d22552329]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ab63b492-92a2-4f3c-be5c-53f45c06c28b req-028e1e51-d239-48da-9879-29b8f8979268 service nova] Releasing lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bae07c-b13a-4e83-9f8f-def29dcc5636]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.041s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f2dd4-9a6f-4a6a-bb8a-d665ec239830]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[029bfe6f-3884-4ff1-a624-09504d3b7157]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:24:38 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:24:38 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb71dfe-78fa-475b-9e3a-627c6995043f]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG os_brick.utils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:24:38 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updating existing volume attachment record: 830c5698-13e7-4976-8d3c-95196b0ac486 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:24:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPlbJoyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:24:48 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:24:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:24:48 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:24:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:24:48 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d0853b-edcf-42a8-91e7-5bac43d7789c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:24:48 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5955e36-b189-4024-a8d5-981a3930646f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba] added
Aug 17 08:24:48 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[85251ef7-f550-4828-b887-e7c1621a69bf]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[36567cc2-8d7f-4814-a021-4aa04b3c176e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPlbJoyR {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPlbJoyR" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8086c6c-3469-40a2-8c98-819bdceaab1b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mPlbJoyR'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3b4634-5b1a-4c4a-841b-05eeb0ec57cf]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[824f6f20-88ce-4473-875d-f9beba71ae31]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:24:49 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:24:49 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:24:49 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:24:49 user nova-compute[72998]: 
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[162fddd1-1ba4-453b-9aa6-a4441f6441dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba, portal: 172.16.0.220,3260]
Aug 17 08:24:49 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba, portal: 172.16.0.220,3260] successful.
Aug 17 08:24:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5568b41c-eb80-4448-ab01-f3236a04670d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[959fa591-b8c2-404c-8e41-48fae35e2ee3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:24:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:24:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1989ba31-9cfb-4850-b5a8-a864ff84f9b7]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-a437e7d2-f143-4c67-bcd6-88dc3219164c req-d463ee71-3851-44e0-ae2e-c6d7877ddd7f service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received event network-changed-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-a437e7d2-f143-4c67-bcd6-88dc3219164c req-d463ee71-3851-44e0-ae2e-c6d7877ddd7f service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Refreshing instance network info cache due to event network-changed-85f6bd9d-2413-407d-9172-9fd50266255a. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a437e7d2-f143-4c67-bcd6-88dc3219164c req-d463ee71-3851-44e0-ae2e-c6d7877ddd7f service nova] Acquiring lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a437e7d2-f143-4c67-bcd6-88dc3219164c req-d463ee71-3851-44e0-ae2e-c6d7877ddd7f service nova] Acquired lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG nova.network.neutron [req-a437e7d2-f143-4c67-bcd6-88dc3219164c req-d463ee71-3851-44e0-ae2e-c6d7877ddd7f service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Refreshing network info cache for port 85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:49 user nova-compute[72998]: INFO nova.compute.manager [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Terminating instance
Aug 17 08:24:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-b7e03e21-d286-49a5-9e37-061a31c87459 req-82344616-35e6-4591-8c9e-0665e449d601 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received event network-vif-unplugged-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b7e03e21-d286-49a5-9e37-061a31c87459 req-82344616-35e6-4591-8c9e-0665e449d601 service nova] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b7e03e21-d286-49a5-9e37-061a31c87459 req-82344616-35e6-4591-8c9e-0665e449d601 service nova] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b7e03e21-d286-49a5-9e37-061a31c87459 req-82344616-35e6-4591-8c9e-0665e449d601 service nova] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-b7e03e21-d286-49a5-9e37-061a31c87459 req-82344616-35e6-4591-8c9e-0665e449d601 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] No waiting events found dispatching network-vif-unplugged-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-b7e03e21-d286-49a5-9e37-061a31c87459 req-82344616-35e6-4591-8c9e-0665e449d601 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received event network-vif-unplugged-85f6bd9d-2413-407d-9172-9fd50266255a for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPlbJoyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26265623465376238', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265623465376238', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.objects.instance [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'flavor' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-a437e7d2-f143-4c67-bcd6-88dc3219164c req-d463ee71-3851-44e0-ae2e-c6d7877ddd7f service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updated VIF entry in instance network info cache for port 85f6bd9d-2413-407d-9172-9fd50266255a. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-a437e7d2-f143-4c67-bcd6-88dc3219164c req-d463ee71-3851-44e0-ae2e-c6d7877ddd7f service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updating instance_info_cache with network_info: [{"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:24:50 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:24:50 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:24:50 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:24:50 user nova-compute[72998]:   <serial>84a0c0ad-efde-4cea-83d6-9dc42122bcba</serial>
Aug 17 08:24:50 user nova-compute[72998]: </disk>
Aug 17 08:24:50 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a437e7d2-f143-4c67-bcd6-88dc3219164c req-d463ee71-3851-44e0-ae2e-c6d7877ddd7f service nova] Releasing lock "refresh_cache-cfbd3131-e61b-45a4-8c69-91081320f046" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:50 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Instance destroyed successfully.
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.objects.instance [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lazy-loading 'resources' on Instance uuid cfbd3131-e61b-45a4-8c69-91081320f046 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-940523251',display_name='tempest-TestStampPattern-server-940523251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-940523251',id=11,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONZnqz4fz+N+JdDC9+VNVpRQxh6Mlne8ooU/TM1lcGerNueG6YDdZwYx4ZrGiVscocoQaLxw+uf1ndX7MqRoz/Bmg7lB1XGzA+NMiG3jzsbCxCIyBAvUWgKK/6+2DK/Eg==',key_name='tempest-TestStampPattern-1214740701',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74f95e7d214049b3831b038a0f0c4d8c',ramdisk_id='',reservation_id='r-g6hlot1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-795414078',owner_user_name='tempest-TestStampPattern-795414078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:38Z,user_data=None,user_id='39227b3a71d243a3acafa9317a45e691',uuid=cfbd3131-e61b-45a4-8c69-91081320f046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converting VIF {"id": "85f6bd9d-2413-407d-9172-9fd50266255a", "address": "fa:16:3e:99:3d:e0", "network": {"id": "50a8b476-e016-438e-91fe-7352c0f03fe6", "bridge": "br-int", "label": "tempest-TestStampPattern-306384533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f95e7d214049b3831b038a0f0c4d8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f6bd9d-24", "ovs_interfaceid": "85f6bd9d-2413-407d-9172-9fd50266255a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:3d:e0,bridge_name='br-int',has_traffic_filtering=True,id=85f6bd9d-2413-407d-9172-9fd50266255a,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6bd9d-24') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG os_vif [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:3d:e0,bridge_name='br-int',has_traffic_filtering=True,id=85f6bd9d-2413-407d-9172-9fd50266255a,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6bd9d-24') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85f6bd9d-24, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:50 user nova-compute[72998]: INFO os_vif [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:3d:e0,bridge_name='br-int',has_traffic_filtering=True,id=85f6bd9d-2413-407d-9172-9fd50266255a,network=Network(50a8b476-e016-438e-91fe-7352c0f03fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f6bd9d-24')
Aug 17 08:24:50 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Deleting instance files /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046_del
Aug 17 08:24:50 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Deletion of /opt/stack/data/nova/instances/cfbd3131-e61b-45a4-8c69-91081320f046_del complete
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No VIF found with MAC fa:16:3e:37:2e:bb, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:24:50 user nova-compute[72998]: INFO nova.compute.manager [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 17 08:24:50 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:24:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-131935eb-faeb-462b-8d76-0d2ab5d6f7df tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.690s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:51 user nova-compute[72998]: INFO nova.compute.manager [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Rescuing
Aug 17 08:24:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:24:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquired lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:24:51 user nova-compute[72998]: DEBUG nova.network.neutron [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:24:51 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:51 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Took 0.84 seconds to deallocate network for instance.
Aug 17 08:24:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-8f648fb6-171d-459f-95de-d0b31791a8b7 req-a042278d-48d9-4226-9360-536a2abf7622 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received event network-vif-deleted-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-6393ce1e-0284-4b08-9d0a-db34bacfb048 req-10340407-54b9-4183-8e4d-44fd0854df74 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received event network-vif-plugged-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6393ce1e-0284-4b08-9d0a-db34bacfb048 req-10340407-54b9-4183-8e4d-44fd0854df74 service nova] Acquiring lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6393ce1e-0284-4b08-9d0a-db34bacfb048 req-10340407-54b9-4183-8e4d-44fd0854df74 service nova] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6393ce1e-0284-4b08-9d0a-db34bacfb048 req-10340407-54b9-4183-8e4d-44fd0854df74 service nova] Lock "cfbd3131-e61b-45a4-8c69-91081320f046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-6393ce1e-0284-4b08-9d0a-db34bacfb048 req-10340407-54b9-4183-8e4d-44fd0854df74 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] No waiting events found dispatching network-vif-plugged-85f6bd9d-2413-407d-9172-9fd50266255a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:52 user nova-compute[72998]: WARNING nova.compute.manager [req-6393ce1e-0284-4b08-9d0a-db34bacfb048 req-10340407-54b9-4183-8e4d-44fd0854df74 service nova] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Received unexpected event network-vif-plugged-85f6bd9d-2413-407d-9172-9fd50266255a for instance with vm_state deleted and task_state None.
Aug 17 08:24:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updating instance_info_cache with network_info: [{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Releasing lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:52 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Deleted allocations for instance cfbd3131-e61b-45a4-8c69-91081320f046
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96aa8441-2900-4146-a346-5fb9b19d51be tempest-TestStampPattern-795414078 tempest-TestStampPattern-795414078-project-member] Lock "cfbd3131-e61b-45a4-8c69-91081320f046" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.577s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Instance destroyed successfully.
Aug 17 08:24:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Attempting rescue
Aug 17 08:24:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72998) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Instance directory exists: not creating {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 08:24:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Creating image(s)
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG nova.objects.instance [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue" returned: 0 in 0.052s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'migration_context' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Start _get_guest_xml network_info=[{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "vif_mac": "fa:16:3e:37:2e:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'resources' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'numa_topology' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:53 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:53 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-102578514',display_name='tempest-ServerRescueNegativeTestJSON-server-102578514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-102578514',id=20,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2Lu0G+dEKk1ITN6VCSNKHeyC2omToYMreON1EfAfUAlW7eydb0N9uRZDyYvmASKGFmKM32HQSYdDfvkNjLnd5zm68d/pHA9Ch82ZE/niVKWuR0qmU+M0OzlxTY5N53hA==',key_name='tempest-keypair-1851076836',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-gyf5fjqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=8067a647-dca0-47d4-a472-eac43a2e4de6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "vif_mac": "fa:16:3e:37:2e:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "vif_mac": "fa:16:3e:37:2e:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:2e:bb,bridge_name='br-int',has_traffic_filtering=True,id=8a57b8a0-b04f-4299-8344-e5c0f2b11bc6,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a57b8a0-b0') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'pci_devices' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:24:53 user nova-compute[72998]:   <uuid>8067a647-dca0-47d4-a472-eac43a2e4de6</uuid>
Aug 17 08:24:53 user nova-compute[72998]:   <name>instance-00000014</name>
Aug 17 08:24:53 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:24:53 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:24:53 user nova-compute[72998]:   <metadata>
Aug 17 08:24:53 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:24:53 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:24:53 user nova-compute[72998]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-102578514</nova:name>
Aug 17 08:24:53 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:24:53</nova:creationTime>
Aug 17 08:24:53 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:24:53 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:24:53 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:24:53 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:24:53 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:24:53 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:24:53 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:24:53 user nova-compute[72998]:       <nova:owner>
Aug 17 08:24:53 user nova-compute[72998]:         <nova:user uuid="4cf59502a7ee46968534c860fc9f49f5">tempest-ServerRescueNegativeTestJSON-826615417-project-member</nova:user>
Aug 17 08:24:53 user nova-compute[72998]:         <nova:project uuid="8eaaef9c2492458bbe646bd227b11b64">tempest-ServerRescueNegativeTestJSON-826615417</nova:project>
Aug 17 08:24:53 user nova-compute[72998]:       </nova:owner>
Aug 17 08:24:53 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:24:53 user nova-compute[72998]:       <nova:ports>
Aug 17 08:24:53 user nova-compute[72998]:         <nova:port uuid="8a57b8a0-b04f-4299-8344-e5c0f2b11bc6">
Aug 17 08:24:53 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 08:24:53 user nova-compute[72998]:         </nova:port>
Aug 17 08:24:53 user nova-compute[72998]:       </nova:ports>
Aug 17 08:24:53 user nova-compute[72998]:     </nova:instance>
Aug 17 08:24:53 user nova-compute[72998]:   </metadata>
Aug 17 08:24:53 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:24:53 user nova-compute[72998]:     <system>
Aug 17 08:24:53 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:24:53 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:24:53 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:24:53 user nova-compute[72998]:       <entry name="serial">8067a647-dca0-47d4-a472-eac43a2e4de6</entry>
Aug 17 08:24:53 user nova-compute[72998]:       <entry name="uuid">8067a647-dca0-47d4-a472-eac43a2e4de6</entry>
Aug 17 08:24:53 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:24:53 user nova-compute[72998]:     </system>
Aug 17 08:24:53 user nova-compute[72998]:   </sysinfo>
Aug 17 08:24:53 user nova-compute[72998]:   <os>
Aug 17 08:24:53 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:24:53 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:24:53 user nova-compute[72998]:   </os>
Aug 17 08:24:53 user nova-compute[72998]:   <features>
Aug 17 08:24:53 user nova-compute[72998]:     <acpi/>
Aug 17 08:24:53 user nova-compute[72998]:     <apic/>
Aug 17 08:24:53 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:24:53 user nova-compute[72998]:   </features>
Aug 17 08:24:53 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:24:53 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:24:53 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:24:53 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:24:53 user nova-compute[72998]:   </clock>
Aug 17 08:24:53 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:24:53 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:24:53 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:24:53 user nova-compute[72998]:   </cpu>
Aug 17 08:24:53 user nova-compute[72998]:   <devices>
Aug 17 08:24:53 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:24:53 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:24:53 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue"/>
Aug 17 08:24:53 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:24:53 user nova-compute[72998]:     </disk>
Aug 17 08:24:53 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:24:53 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:24:53 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk"/>
Aug 17 08:24:53 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:24:53 user nova-compute[72998]:     </disk>
Aug 17 08:24:53 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:24:53 user nova-compute[72998]:       <mac address="fa:16:3e:37:2e:bb"/>
Aug 17 08:24:53 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:24:53 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:24:53 user nova-compute[72998]:       <target dev="tap8a57b8a0-b0"/>
Aug 17 08:24:53 user nova-compute[72998]:     </interface>
Aug 17 08:24:53 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:24:53 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/console.log" append="off"/>
Aug 17 08:24:53 user nova-compute[72998]:     </serial>
Aug 17 08:24:53 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:24:53 user nova-compute[72998]:     <video>
Aug 17 08:24:53 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:24:53 user nova-compute[72998]:     </video>
Aug 17 08:24:53 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:24:53 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:24:53 user nova-compute[72998]:     </rng>
Aug 17 08:24:53 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:24:53 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:24:53 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:24:53 user nova-compute[72998]:     </memballoon>
Aug 17 08:24:53 user nova-compute[72998]:   </devices>
Aug 17 08:24:53 user nova-compute[72998]: </domain>
Aug 17 08:24:53 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:24:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Instance destroyed successfully.
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] No VIF found with MAC fa:16:3e:37:2e:bb, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-unplugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-unplugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:53 user nova-compute[72998]: WARNING nova.compute.manager [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-unplugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state active and task_state rescuing.
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:53 user nova-compute[72998]: WARNING nova.compute.manager [req-73cda25f-a707-4012-9983-275cacedafd0 req-5be526a2-a8d7-4ec4-83c2-bdab39680047 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state active and task_state rescuing.
Aug 17 08:24:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:55 user nova-compute[72998]: WARNING nova.compute.manager [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state active and task_state rescuing.
Aug 17 08:24:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:55 user nova-compute[72998]: WARNING nova.compute.manager [req-8d5d6d94-1fe3-49d4-b1c2-9ee637a950b6 req-948d55f2-f740-4312-a5d5-1a6618459f7f service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state active and task_state rescuing.
Aug 17 08:24:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:56 user nova-compute[72998]: INFO nova.compute.manager [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Terminating instance
Aug 17 08:24:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for 8067a647-dca0-47d4-a472-eac43a2e4de6 due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260696.9104755, 8067a647-dca0-47d4-a472-eac43a2e4de6 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:24:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] VM Resumed (Lifecycle Event)
Aug 17 08:24:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-49ce1973-d025-4483-b82d-3f8c45c86058 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 08:24:56 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260696.911379, 8067a647-dca0-47d4-a472-eac43a2e4de6 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:24:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] VM Started (Lifecycle Event)
Aug 17 08:24:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:57 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Instance destroyed successfully.
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.objects.instance [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'resources' on Instance uuid 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1227355977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1227355977',id=15,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Ao/Go/8XDt42KXZYAz7AA6xYP7QW9nvLmuMDh5kL5LttNu902QcyLN6d7iY1AKVZtdM+xSQn+inyBY6PhC2wTcUIs19u3C4QCCleb9u11G3dMj8vS2CmA4ZNcVsXapw==',key_name='tempest-keypair-198637846',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-9031z9p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "1177fb3c-1f8f-489c-ada6-748478daa64b", "address": "fa:16:3e:a4:6c:80", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1177fb3c-1f", "ovs_interfaceid": "1177fb3c-1f8f-489c-ada6-748478daa64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG os_vif [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1177fb3c-1f, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:24:57 user nova-compute[72998]: INFO os_vif [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6c:80,bridge_name='br-int',has_traffic_filtering=True,id=1177fb3c-1f8f-489c-ada6-748478daa64b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1177fb3c-1f')
Aug 17 08:24:57 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Deleting instance files /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66_del
Aug 17 08:24:57 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Deletion of /opt/stack/data/nova/instances/9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66_del complete
Aug 17 08:24:57 user nova-compute[72998]: INFO nova.compute.manager [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 08:24:57 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-unplugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] No waiting events found dispatching network-vif-unplugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-unplugged-1177fb3c-1f8f-489c-ada6-748478daa64b for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] Acquiring lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] No waiting events found dispatching network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:24:57 user nova-compute[72998]: WARNING nova.compute.manager [req-71c2fea9-3b59-4097-8fba-f938047bf0da req-ab87985a-bb71-4917-aa13-a320efbe9330 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received unexpected event network-vif-plugged-1177fb3c-1f8f-489c-ada6-748478daa64b for instance with vm_state active and task_state deleting.
Aug 17 08:24:58 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:58 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Took 0.81 seconds to deallocate network for instance.
Aug 17 08:24:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-280bbf3e-4e71-48e7-933f-10ffe120ef45 req-8532aff0-812f-4279-b86b-1ae5e0d16534 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Received event network-vif-deleted-1177fb3c-1f8f-489c-ada6-748478daa64b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:24:58 user nova-compute[72998]: INFO nova.compute.manager [req-280bbf3e-4e71-48e7-933f-10ffe120ef45 req-8532aff0-812f-4279-b86b-1ae5e0d16534 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Neutron deleted interface 1177fb3c-1f8f-489c-ada6-748478daa64b; detaching it from the instance and deleting it from the info cache
Aug 17 08:24:58 user nova-compute[72998]: DEBUG nova.network.neutron [req-280bbf3e-4e71-48e7-933f-10ffe120ef45 req-8532aff0-812f-4279-b86b-1ae5e0d16534 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:24:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-280bbf3e-4e71-48e7-933f-10ffe120ef45 req-8532aff0-812f-4279-b86b-1ae5e0d16534 service nova] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Detach interface failed, port_id=1177fb3c-1f8f-489c-ada6-748478daa64b, reason: Instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:24:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:24:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:24:58 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:24:58 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:24:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:24:58 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Deleted allocations for instance 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66
Aug 17 08:24:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-53f5ffc2-56ae-491e-97c0-8c491931e040 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.154s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:25:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:25:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 08:25:05 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260690.7487383, cfbd3131-e61b-45a4-8c69-91081320f046 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:25:05 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] VM Stopped (Lifecycle Event)
Aug 17 08:25:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8be7a31-2345-4502-b501-a78db1ac3308 None None] [instance: cfbd3131-e61b-45a4-8c69-91081320f046] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:25:05 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:25:10 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:25:10 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7419MB free_disk=24.113445281982422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 794e686e-2e6a-42f5-b817-5d18d2ad705e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8067a647-dca0-47d4-a472-eac43a2e4de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8b55bd93-be1c-4b78-ab1a-adba05d5efde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 08:25:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 08:25:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:25:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:12 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260697.6294923, 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:25:12 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] VM Stopped (Lifecycle Event)
Aug 17 08:25:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2d89eb5e-e370-4357-a0b7-9d3e11c46bc2 None None] [instance: 9f304b6b-0ad5-4cf8-b2f1-042b6ff0de66] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:25:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:25:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:16 user nova-compute[72998]: INFO nova.compute.manager [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Terminating instance
Aug 17 08:25:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-e9710de0-0139-448d-9abf-4cef59674408 req-42247e01-e18d-4775-996a-155e4f70d3da service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-unplugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e9710de0-0139-448d-9abf-4cef59674408 req-42247e01-e18d-4775-996a-155e4f70d3da service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e9710de0-0139-448d-9abf-4cef59674408 req-42247e01-e18d-4775-996a-155e4f70d3da service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e9710de0-0139-448d-9abf-4cef59674408 req-42247e01-e18d-4775-996a-155e4f70d3da service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-e9710de0-0139-448d-9abf-4cef59674408 req-42247e01-e18d-4775-996a-155e4f70d3da service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-unplugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-e9710de0-0139-448d-9abf-4cef59674408 req-42247e01-e18d-4775-996a-155e4f70d3da service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-unplugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Instance destroyed successfully.
Aug 17 08:25:17 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lazy-loading 'resources' on Instance uuid 794e686e-2e6a-42f5-b817-5d18d2ad705e {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-568118166',display_name='tempest-ServerStableDeviceRescueTest-server-568118166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-568118166',id=12,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFoA5hMyyiQ9viW/O8jFPBLdISk/aDucVxb9hWkjB2hv7CHUVFi3GGx9ludTZ07TvnXYluZDk6yEtsSALMXSKfg4YR4YfCFcRR4EFK//wWhiIg9gQCvwW+r9dNFcEDIdA==',key_name='tempest-keypair-1604276468',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:22:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0a5f424a6894c6ca4148962ede48515',ramdisk_id='',reservation_id='r-kxqkhjat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1264944838',owner_user_name='tempest-ServerStableDeviceRescueTest-1264944838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:23:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c2d6611c58043b49fb9f2ab7ce26288',uuid=794e686e-2e6a-42f5-b817-5d18d2ad705e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Converting VIF {"id": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "address": "fa:16:3e:b4:7f:f0", "network": {"id": "bbdc418d-15ca-46dd-923d-86e61709d4d2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-504875593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a5f424a6894c6ca4148962ede48515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f14bfc7-3d", "ovs_interfaceid": "4f14bfc7-3d2d-4f6f-ad48-80946cac3cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:7f:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f14bfc7-3d2d-4f6f-ad48-80946cac3cef,network=Network(bbdc418d-15ca-46dd-923d-86e61709d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f14bfc7-3d') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG os_vif [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:7f:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f14bfc7-3d2d-4f6f-ad48-80946cac3cef,network=Network(bbdc418d-15ca-46dd-923d-86e61709d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f14bfc7-3d') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f14bfc7-3d, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:25:17 user nova-compute[72998]: INFO os_vif [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:7f:f0,bridge_name='br-int',has_traffic_filtering=True,id=4f14bfc7-3d2d-4f6f-ad48-80946cac3cef,network=Network(bbdc418d-15ca-46dd-923d-86e61709d4d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f14bfc7-3d')
Aug 17 08:25:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Deleting instance files /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e_del
Aug 17 08:25:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Deletion of /opt/stack/data/nova/instances/794e686e-2e6a-42f5-b817-5d18d2ad705e_del complete
Aug 17 08:25:17 user nova-compute[72998]: INFO nova.compute.manager [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 17 08:25:17 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:25:17 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:25:18 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:25:18 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Took 0.80 seconds to deallocate network for instance.
Aug 17 08:25:18 user nova-compute[72998]: DEBUG nova.compute.manager [req-10cea241-24fa-41e3-9099-802e837d69ee req-bd3c9de4-5183-4ef9-9c5d-5ef0e398b598 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-deleted-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:18 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:25:18 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:25:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:19 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Deleted allocations for instance 794e686e-2e6a-42f5-b817-5d18d2ad705e
Aug 17 08:25:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9f749374-1a70-413a-84aa-cab345cd09f8 tempest-ServerStableDeviceRescueTest-1264944838 tempest-ServerStableDeviceRescueTest-1264944838-project-member] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.332s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-72e2ffd3-8fdb-4e7f-82e5-4d0b84619a21 req-cbe019fe-ec16-425c-b688-e61b36df2d37 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-72e2ffd3-8fdb-4e7f-82e5-4d0b84619a21 req-cbe019fe-ec16-425c-b688-e61b36df2d37 service nova] Acquiring lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-72e2ffd3-8fdb-4e7f-82e5-4d0b84619a21 req-cbe019fe-ec16-425c-b688-e61b36df2d37 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-72e2ffd3-8fdb-4e7f-82e5-4d0b84619a21 req-cbe019fe-ec16-425c-b688-e61b36df2d37 service nova] Lock "794e686e-2e6a-42f5-b817-5d18d2ad705e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-72e2ffd3-8fdb-4e7f-82e5-4d0b84619a21 req-cbe019fe-ec16-425c-b688-e61b36df2d37 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] No waiting events found dispatching network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:25:19 user nova-compute[72998]: WARNING nova.compute.manager [req-72e2ffd3-8fdb-4e7f-82e5-4d0b84619a21 req-cbe019fe-ec16-425c-b688-e61b36df2d37 service nova] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Received unexpected event network-vif-plugged-4f14bfc7-3d2d-4f6f-ad48-80946cac3cef for instance with vm_state deleted and task_state None.
Aug 17 08:25:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:25:26 user nova-compute[72998]: INFO nova.compute.claims [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Claim successful on node user
Aug 17 08:25:26 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:25:26 user nova-compute[72998]: DEBUG nova.network.neutron [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:25:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:25:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:25:26 user nova-compute[72998]: INFO nova.virt.block_device [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Booting with blank volume at /dev/vda
Aug 17 08:25:26 user nova-compute[72998]: DEBUG nova.policy [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf94d9d63f9e4e5a9d0a4f175fddff16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef0a0f5a7b6484483231263041317df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:25:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Successfully created port: bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG nova.network.neutron [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Successfully updated port: bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquired lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG nova.network.neutron [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-1bf27753-be28-4f40-ad02-6a808edfb51b req-6713d335-24a9-46f6-9663-9c716965d331 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-changed-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-1bf27753-be28-4f40-ad02-6a808edfb51b req-6713d335-24a9-46f6-9663-9c716965d331 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Refreshing instance network info cache due to event network-changed-bff9c917-7426-41b6-af07-b62567ce81df. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1bf27753-be28-4f40-ad02-6a808edfb51b req-6713d335-24a9-46f6-9663-9c716965d331 service nova] Acquiring lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG nova.network.neutron [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG nova.network.neutron [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updating instance_info_cache with network_info: [{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Releasing lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Instance network_info: |[{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1bf27753-be28-4f40-ad02-6a808edfb51b req-6713d335-24a9-46f6-9663-9c716965d331 service nova] Acquired lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:25:28 user nova-compute[72998]: DEBUG nova.network.neutron [req-1bf27753-be28-4f40-ad02-6a808edfb51b req-6713d335-24a9-46f6-9663-9c716965d331 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Refreshing network info cache for port bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:25:29 user nova-compute[72998]: DEBUG nova.network.neutron [req-1bf27753-be28-4f40-ad02-6a808edfb51b req-6713d335-24a9-46f6-9663-9c716965d331 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updated VIF entry in instance network info cache for port bff9c917-7426-41b6-af07-b62567ce81df. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:25:29 user nova-compute[72998]: DEBUG nova.network.neutron [req-1bf27753-be28-4f40-ad02-6a808edfb51b req-6713d335-24a9-46f6-9663-9c716965d331 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updating instance_info_cache with network_info: [{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:25:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1bf27753-be28-4f40-ad02-6a808edfb51b req-6713d335-24a9-46f6-9663-9c716965d331 service nova] Releasing lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG os_brick.utils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[24979563-d279-4100-ac28-7d4a02cd6d4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0417590b-c23c-4173-8f85-0cee4fea6434]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc00de-8a97-445d-bced-c482469fe1a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4093d49-3741-411a-a5c8-3cbc82af51e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:25:32 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:25:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5b2853-c0a8-45df-8b7b-34ba16097d48]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG os_brick.utils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updating existing volume attachment record: e71bf72e-6825-479c-8abb-607c8ae71e6f {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260717.7036808, 794e686e-2e6a-42f5-b817-5d18d2ad705e => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:25:32 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] VM Stopped (Lifecycle Event)
Aug 17 08:25:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-02644e1d-c0b2-4f36-86ec-7be47b96228a None None] [instance: 794e686e-2e6a-42f5-b817-5d18d2ad705e] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:25:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:25:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:25:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:25:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:25:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:25:43 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Creating image(s)
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Ensure instance console log exists: /opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Start _get_guest_xml network_info=[{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e71bf72e-6825-479c-8abb-607c8ae71e6f', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnBVzviS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd87b6f0b-95ce-41b2-b279-cab1f2d1175c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e320fe64-93f4-4500-8e29-d108f2f221e3', 'serial': 'e320fe64-93f4-4500-8e29-d108f2f221e3'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:25:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:25:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnBVzviS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:25:43 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:25:43 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:25:43 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0409ba3-294a-4d09-bc83-1d146184fe12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:25:43 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e636f284-df8b-434a-97e4-733530f53a97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3] added
Aug 17 08:25:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5557e02d-afff-4b2a-9c0c-a82fb664f3bd]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3353c609-55b2-464b-8b2c-036690dfd086]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnBVzviS {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnBVzviS" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a0dea4-cab8-414a-8574-5a563c25481b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RnBVzviS'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae2bb1d-4e51-4e80-a830-489a57b659ed]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7352e7c7-7ebd-404b-b2d3-a683ecdacd80]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:25:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:25:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d171664-e32a-43bb-b567-99c90715a658]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3, portal: 172.16.0.220,3260]
Aug 17 08:25:43 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3, portal: 172.16.0.220,3260] successful.
Aug 17 08:25:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20fc0f2-4a08-4e72-b5a2-f0e9b0e884b8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b93d7b6-d87d-467d-8b38-d0f0fc85b6b8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:25:43 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:25:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:25:43 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:25:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[86353152-eeac-4c94-8a3a-9aa053de025f]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:25:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnBVzviS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26434346665353263', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434346665353263', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-531330378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-531330378',id=24,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-ymmjmalx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:25:27Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=d87b6f0b-95ce-41b2-b279-cab1f2d1175c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6f:a1,bridge_name='br-int',has_traffic_filtering=True,id=bff9c917-7426-41b6-af07-b62567ce81df,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbff9c917-74') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.objects.instance [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'pci_devices' on Instance uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:25:44 user nova-compute[72998]:   <uuid>d87b6f0b-95ce-41b2-b279-cab1f2d1175c</uuid>
Aug 17 08:25:44 user nova-compute[72998]:   <name>instance-00000018</name>
Aug 17 08:25:44 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:25:44 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:25:44 user nova-compute[72998]:   <metadata>
Aug 17 08:25:44 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:25:44 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:25:44 user nova-compute[72998]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-531330378</nova:name>
Aug 17 08:25:44 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:25:43</nova:creationTime>
Aug 17 08:25:44 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:25:44 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:25:44 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:25:44 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:25:44 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:25:44 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:25:44 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:25:44 user nova-compute[72998]:       <nova:owner>
Aug 17 08:25:44 user nova-compute[72998]:         <nova:user uuid="cf94d9d63f9e4e5a9d0a4f175fddff16">tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member</nova:user>
Aug 17 08:25:44 user nova-compute[72998]:         <nova:project uuid="0ef0a0f5a7b6484483231263041317df">tempest-ServerBootFromVolumeStableRescueTest-1298365870</nova:project>
Aug 17 08:25:44 user nova-compute[72998]:       </nova:owner>
Aug 17 08:25:44 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:25:44 user nova-compute[72998]:       <nova:ports>
Aug 17 08:25:44 user nova-compute[72998]:         <nova:port uuid="bff9c917-7426-41b6-af07-b62567ce81df">
Aug 17 08:25:44 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 08:25:44 user nova-compute[72998]:         </nova:port>
Aug 17 08:25:44 user nova-compute[72998]:       </nova:ports>
Aug 17 08:25:44 user nova-compute[72998]:     </nova:instance>
Aug 17 08:25:44 user nova-compute[72998]:   </metadata>
Aug 17 08:25:44 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:25:44 user nova-compute[72998]:     <system>
Aug 17 08:25:44 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:25:44 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:25:44 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:25:44 user nova-compute[72998]:       <entry name="serial">d87b6f0b-95ce-41b2-b279-cab1f2d1175c</entry>
Aug 17 08:25:44 user nova-compute[72998]:       <entry name="uuid">d87b6f0b-95ce-41b2-b279-cab1f2d1175c</entry>
Aug 17 08:25:44 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:25:44 user nova-compute[72998]:     </system>
Aug 17 08:25:44 user nova-compute[72998]:   </sysinfo>
Aug 17 08:25:44 user nova-compute[72998]:   <os>
Aug 17 08:25:44 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:25:44 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:25:44 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:25:44 user nova-compute[72998]:   </os>
Aug 17 08:25:44 user nova-compute[72998]:   <features>
Aug 17 08:25:44 user nova-compute[72998]:     <acpi/>
Aug 17 08:25:44 user nova-compute[72998]:     <apic/>
Aug 17 08:25:44 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:25:44 user nova-compute[72998]:   </features>
Aug 17 08:25:44 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:25:44 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:25:44 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:25:44 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:25:44 user nova-compute[72998]:   </clock>
Aug 17 08:25:44 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:25:44 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:25:44 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:25:44 user nova-compute[72998]:   </cpu>
Aug 17 08:25:44 user nova-compute[72998]:   <devices>
Aug 17 08:25:44 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:25:44 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:25:44 user nova-compute[72998]:       <source dev="/dev/sdc"/>
Aug 17 08:25:44 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:25:44 user nova-compute[72998]:       <serial>e320fe64-93f4-4500-8e29-d108f2f221e3</serial>
Aug 17 08:25:44 user nova-compute[72998]:     </disk>
Aug 17 08:25:44 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:25:44 user nova-compute[72998]:       <mac address="fa:16:3e:7c:6f:a1"/>
Aug 17 08:25:44 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:25:44 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:25:44 user nova-compute[72998]:       <target dev="tapbff9c917-74"/>
Aug 17 08:25:44 user nova-compute[72998]:     </interface>
Aug 17 08:25:44 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:25:44 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/console.log" append="off"/>
Aug 17 08:25:44 user nova-compute[72998]:     </serial>
Aug 17 08:25:44 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:25:44 user nova-compute[72998]:     <video>
Aug 17 08:25:44 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:25:44 user nova-compute[72998]:     </video>
Aug 17 08:25:44 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:25:44 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:25:44 user nova-compute[72998]:     </rng>
Aug 17 08:25:44 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:25:44 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:25:44 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:25:44 user nova-compute[72998]:     </memballoon>
Aug 17 08:25:44 user nova-compute[72998]:   </devices>
Aug 17 08:25:44 user nova-compute[72998]: </domain>
Aug 17 08:25:44 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-531330378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-531330378',id=24,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-ymmjmalx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:25:27Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=d87b6f0b-95ce-41b2-b279-cab1f2d1175c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6f:a1,bridge_name='br-int',has_traffic_filtering=True,id=bff9c917-7426-41b6-af07-b62567ce81df,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbff9c917-74') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG os_vif [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6f:a1,bridge_name='br-int',has_traffic_filtering=True,id=bff9c917-7426-41b6-af07-b62567ce81df,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbff9c917-74') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbff9c917-74, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbff9c917-74, col_values=(('external_ids', {'iface-id': 'bff9c917-7426-41b6-af07-b62567ce81df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:6f:a1', 'vm-uuid': 'd87b6f0b-95ce-41b2-b279-cab1f2d1175c'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:44 user nova-compute[72998]: INFO os_vif [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6f:a1,bridge_name='br-int',has_traffic_filtering=True,id=bff9c917-7426-41b6-af07-b62567ce81df,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbff9c917-74')
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:25:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No VIF found with MAC fa:16:3e:7c:6f:a1, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:25:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-0d181c3f-342d-4937-96c2-624b37e00ea4 req-6938e571-7424-4227-a577-bfd7ec93f176 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0d181c3f-342d-4937-96c2-624b37e00ea4 req-6938e571-7424-4227-a577-bfd7ec93f176 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0d181c3f-342d-4937-96c2-624b37e00ea4 req-6938e571-7424-4227-a577-bfd7ec93f176 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0d181c3f-342d-4937-96c2-624b37e00ea4 req-6938e571-7424-4227-a577-bfd7ec93f176 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-0d181c3f-342d-4937-96c2-624b37e00ea4 req-6938e571-7424-4227-a577-bfd7ec93f176 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:25:46 user nova-compute[72998]: WARNING nova.compute.manager [req-0d181c3f-342d-4937-96c2-624b37e00ea4 req-6938e571-7424-4227-a577-bfd7ec93f176 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state building and task_state spawning.
Aug 17 08:25:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:25:47 user nova-compute[72998]: INFO nova.compute.claims [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Claim successful on node user
Aug 17 08:25:47 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:25:47 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:25:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:25:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:25:48 user nova-compute[72998]: INFO nova.virt.block_device [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Booting with volume 9fb70aa3-b710-4008-951d-e0e5efb221b5 at /dev/vda
Aug 17 08:25:48 user nova-compute[72998]: DEBUG os_brick.utils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f81e0-8c81-4614-bced-bd6a089b3397]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f29862-3146-4d4a-b794-30a3ee598ea9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13404d1-c503-4cb8-be35-12c9849eb792]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.policy [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0be579ee85cb4ac2b59812bbee48c272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62167eb6909402f8dca89678acff055', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da845db-c5b4-4c5f-abcb-fd5a2611fe5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260748.207755, d87b6f0b-95ce-41b2-b279-cab1f2d1175c => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:25:48 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] VM Resumed (Lifecycle Event)
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:25:48 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15ecc3a-0321-4669-bd0e-4df49dbd58f8]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG os_brick.utils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== get_connector_properties: return (252ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating existing volume attachment record: 48656294-bdf3-4455-892b-f40af3b06e4c {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:25:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Instance spawned successfully.
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-a0026da2-87ac-4fa3-9b60-f757dcee9c03 req-b2b8ddc5-f92d-455a-9591-21892f6c8949 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a0026da2-87ac-4fa3-9b60-f757dcee9c03 req-b2b8ddc5-f92d-455a-9591-21892f6c8949 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a0026da2-87ac-4fa3-9b60-f757dcee9c03 req-b2b8ddc5-f92d-455a-9591-21892f6c8949 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a0026da2-87ac-4fa3-9b60-f757dcee9c03 req-b2b8ddc5-f92d-455a-9591-21892f6c8949 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-a0026da2-87ac-4fa3-9b60-f757dcee9c03 req-b2b8ddc5-f92d-455a-9591-21892f6c8949 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:25:48 user nova-compute[72998]: WARNING nova.compute.manager [req-a0026da2-87ac-4fa3-9b60-f757dcee9c03 req-b2b8ddc5-f92d-455a-9591-21892f6c8949 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state building and task_state spawning.
Aug 17 08:25:48 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260748.2081542, d87b6f0b-95ce-41b2-b279-cab1f2d1175c => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:25:48 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] VM Started (Lifecycle Event)
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:25:48 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:25:48 user nova-compute[72998]: INFO nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 17 08:25:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:25:48 user nova-compute[72998]: INFO nova.compute.manager [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Took 22.55 seconds to build instance.
Aug 17 08:25:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-355670de-dabc-4778-a417-c23560b5a6d1 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.650s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Successfully created port: 726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:25:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Successfully updated port: 726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:25:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:25:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquired lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:25:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-f932a2c2-6599-4ecb-9b23-5836c1ed8112 req-585c580a-1b05-47dc-bc39-8556c61a36f5 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-changed-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-f932a2c2-6599-4ecb-9b23-5836c1ed8112 req-585c580a-1b05-47dc-bc39-8556c61a36f5 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Refreshing instance network info cache due to event network-changed-726f4b3e-5fa4-4747-8f97-a1c7853bf57e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f932a2c2-6599-4ecb-9b23-5836c1ed8112 req-585c580a-1b05-47dc-bc39-8556c61a36f5 service nova] Acquiring lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating instance_info_cache with network_info: [{"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Releasing lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Instance network_info: |[{"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f932a2c2-6599-4ecb-9b23-5836c1ed8112 req-585c580a-1b05-47dc-bc39-8556c61a36f5 service nova] Acquired lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG nova.network.neutron [req-f932a2c2-6599-4ecb-9b23-5836c1ed8112 req-585c580a-1b05-47dc-bc39-8556c61a36f5 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Refreshing network info cache for port 726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:25:51 user nova-compute[72998]: INFO nova.compute.claims [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Claim successful on node user
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.network.neutron [req-f932a2c2-6599-4ecb-9b23-5836c1ed8112 req-585c580a-1b05-47dc-bc39-8556c61a36f5 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updated VIF entry in instance network info cache for port 726f4b3e-5fa4-4747-8f97-a1c7853bf57e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.network.neutron [req-f932a2c2-6599-4ecb-9b23-5836c1ed8112 req-585c580a-1b05-47dc-bc39-8556c61a36f5 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating instance_info_cache with network_info: [{"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f932a2c2-6599-4ecb-9b23-5836c1ed8112 req-585c580a-1b05-47dc-bc39-8556c61a36f5 service nova] Releasing lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:25:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:25:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Creating image(s)
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG nova.policy [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf8febbec4ce4eb9a0132c51fae76de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846580b37b3545319d1897e07c828c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk 1073741824" returned: 0 in 0.048s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Checking if we can resize image /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Successfully created port: 5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Cannot resize image /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'migration_context' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Ensure instance console log exists: /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Successfully updated port: 5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquired lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:25:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-b27d3694-070a-4623-b06d-1f2df2dd0063 req-2a34eee1-8e70-4640-a198-cc475d1f21be service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-changed-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-b27d3694-070a-4623-b06d-1f2df2dd0063 req-2a34eee1-8e70-4640-a198-cc475d1f21be service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Refreshing instance network info cache due to event network-changed-5160fa81-e465-4cf0-b0a0-862256c60f8b. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b27d3694-070a-4623-b06d-1f2df2dd0063 req-2a34eee1-8e70-4640-a198-cc475d1f21be service nova] Acquiring lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updating instance_info_cache with network_info: [{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Releasing lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance network_info: |[{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b27d3694-070a-4623-b06d-1f2df2dd0063 req-2a34eee1-8e70-4640-a198-cc475d1f21be service nova] Acquired lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.network.neutron [req-b27d3694-070a-4623-b06d-1f2df2dd0063 req-2a34eee1-8e70-4640-a198-cc475d1f21be service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Refreshing network info cache for port 5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Start _get_guest_xml network_info=[{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:25:54 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:25:54 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2116780994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2116780994',id=26,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBTxnYxvo0uWtR5DDPn4Y7ih+7xoHXCALaDB711cb16A/xwqCq8+SdyaE419S/Pag051ZYUroUtYYfDERIa7JrJbquhP62+TE9hkelD8yUpjZ2kPnUfiyH8ECV7KdfEzw==',key_name='tempest-keypair-1914279933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-zjvfbzbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:25:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=382786b5-2479-4260-8be7-e56513d85fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'pci_devices' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:25:54 user nova-compute[72998]:   <uuid>382786b5-2479-4260-8be7-e56513d85fb3</uuid>
Aug 17 08:25:54 user nova-compute[72998]:   <name>instance-0000001a</name>
Aug 17 08:25:54 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:25:54 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:25:54 user nova-compute[72998]:   <metadata>
Aug 17 08:25:54 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:25:54 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:25:54 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2116780994</nova:name>
Aug 17 08:25:54 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:25:54</nova:creationTime>
Aug 17 08:25:54 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:25:54 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:25:54 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:25:54 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:25:54 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:25:54 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:25:54 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:25:54 user nova-compute[72998]:       <nova:owner>
Aug 17 08:25:54 user nova-compute[72998]:         <nova:user uuid="cf8febbec4ce4eb9a0132c51fae76de1">tempest-AttachVolumeShelveTestJSON-257833239-project-member</nova:user>
Aug 17 08:25:54 user nova-compute[72998]:         <nova:project uuid="846580b37b3545319d1897e07c828c59">tempest-AttachVolumeShelveTestJSON-257833239</nova:project>
Aug 17 08:25:54 user nova-compute[72998]:       </nova:owner>
Aug 17 08:25:54 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:25:54 user nova-compute[72998]:       <nova:ports>
Aug 17 08:25:54 user nova-compute[72998]:         <nova:port uuid="5160fa81-e465-4cf0-b0a0-862256c60f8b">
Aug 17 08:25:54 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 08:25:54 user nova-compute[72998]:         </nova:port>
Aug 17 08:25:54 user nova-compute[72998]:       </nova:ports>
Aug 17 08:25:54 user nova-compute[72998]:     </nova:instance>
Aug 17 08:25:54 user nova-compute[72998]:   </metadata>
Aug 17 08:25:54 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:25:54 user nova-compute[72998]:     <system>
Aug 17 08:25:54 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:25:54 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:25:54 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:25:54 user nova-compute[72998]:       <entry name="serial">382786b5-2479-4260-8be7-e56513d85fb3</entry>
Aug 17 08:25:54 user nova-compute[72998]:       <entry name="uuid">382786b5-2479-4260-8be7-e56513d85fb3</entry>
Aug 17 08:25:54 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:25:54 user nova-compute[72998]:     </system>
Aug 17 08:25:54 user nova-compute[72998]:   </sysinfo>
Aug 17 08:25:54 user nova-compute[72998]:   <os>
Aug 17 08:25:54 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:25:54 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:25:54 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:25:54 user nova-compute[72998]:   </os>
Aug 17 08:25:54 user nova-compute[72998]:   <features>
Aug 17 08:25:54 user nova-compute[72998]:     <acpi/>
Aug 17 08:25:54 user nova-compute[72998]:     <apic/>
Aug 17 08:25:54 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:25:54 user nova-compute[72998]:   </features>
Aug 17 08:25:54 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:25:54 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:25:54 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:25:54 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:25:54 user nova-compute[72998]:   </clock>
Aug 17 08:25:54 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:25:54 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:25:54 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:25:54 user nova-compute[72998]:   </cpu>
Aug 17 08:25:54 user nova-compute[72998]:   <devices>
Aug 17 08:25:54 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:25:54 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:25:54 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk"/>
Aug 17 08:25:54 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:25:54 user nova-compute[72998]:     </disk>
Aug 17 08:25:54 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:25:54 user nova-compute[72998]:       <mac address="fa:16:3e:51:39:e0"/>
Aug 17 08:25:54 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:25:54 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:25:54 user nova-compute[72998]:       <target dev="tap5160fa81-e4"/>
Aug 17 08:25:54 user nova-compute[72998]:     </interface>
Aug 17 08:25:54 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:25:54 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/console.log" append="off"/>
Aug 17 08:25:54 user nova-compute[72998]:     </serial>
Aug 17 08:25:54 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:25:54 user nova-compute[72998]:     <video>
Aug 17 08:25:54 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:25:54 user nova-compute[72998]:     </video>
Aug 17 08:25:54 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:25:54 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:25:54 user nova-compute[72998]:     </rng>
Aug 17 08:25:54 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:25:54 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:25:54 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:25:54 user nova-compute[72998]:     </memballoon>
Aug 17 08:25:54 user nova-compute[72998]:   </devices>
Aug 17 08:25:54 user nova-compute[72998]: </domain>
Aug 17 08:25:54 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2116780994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2116780994',id=26,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBTxnYxvo0uWtR5DDPn4Y7ih+7xoHXCALaDB711cb16A/xwqCq8+SdyaE419S/Pag051ZYUroUtYYfDERIa7JrJbquhP62+TE9hkelD8yUpjZ2kPnUfiyH8ECV7KdfEzw==',key_name='tempest-keypair-1914279933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-zjvfbzbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:25:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=382786b5-2479-4260-8be7-e56513d85fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG os_vif [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5160fa81-e4, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5160fa81-e4, col_values=(('external_ids', {'iface-id': '5160fa81-e465-4cf0-b0a0-862256c60f8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:39:e0', 'vm-uuid': '382786b5-2479-4260-8be7-e56513d85fb3'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:54 user nova-compute[72998]: INFO os_vif [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4')
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:25:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] No VIF found with MAC fa:16:3e:51:39:e0, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:25:55 user nova-compute[72998]: DEBUG nova.network.neutron [req-b27d3694-070a-4623-b06d-1f2df2dd0063 req-2a34eee1-8e70-4640-a198-cc475d1f21be service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updated VIF entry in instance network info cache for port 5160fa81-e465-4cf0-b0a0-862256c60f8b. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:25:55 user nova-compute[72998]: DEBUG nova.network.neutron [req-b27d3694-070a-4623-b06d-1f2df2dd0063 req-2a34eee1-8e70-4640-a198-cc475d1f21be service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updating instance_info_cache with network_info: [{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:25:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b27d3694-070a-4623-b06d-1f2df2dd0063 req-2a34eee1-8e70-4640-a198-cc475d1f21be service nova] Releasing lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:25:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-7ed5af97-1271-4bb1-95a8-c9bdd21f437c req-02b6875b-6759-43c5-8c0a-efe6c9963fdd service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-changed-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-7ed5af97-1271-4bb1-95a8-c9bdd21f437c req-02b6875b-6759-43c5-8c0a-efe6c9963fdd service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Refreshing instance network info cache due to event network-changed-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:25:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7ed5af97-1271-4bb1-95a8-c9bdd21f437c req-02b6875b-6759-43c5-8c0a-efe6c9963fdd service nova] Acquiring lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:25:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7ed5af97-1271-4bb1-95a8-c9bdd21f437c req-02b6875b-6759-43c5-8c0a-efe6c9963fdd service nova] Acquired lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:25:55 user nova-compute[72998]: DEBUG nova.network.neutron [req-7ed5af97-1271-4bb1-95a8-c9bdd21f437c req-02b6875b-6759-43c5-8c0a-efe6c9963fdd service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Refreshing network info cache for port e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6b12711-be80-42c7-91a1-103a6602e517 req-5932bd1f-cc73-4e00-ab44-c9b783493b25 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6b12711-be80-42c7-91a1-103a6602e517 req-5932bd1f-cc73-4e00-ab44-c9b783493b25 service nova] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6b12711-be80-42c7-91a1-103a6602e517 req-5932bd1f-cc73-4e00-ab44-c9b783493b25 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6b12711-be80-42c7-91a1-103a6602e517 req-5932bd1f-cc73-4e00-ab44-c9b783493b25 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6b12711-be80-42c7-91a1-103a6602e517 req-5932bd1f-cc73-4e00-ab44-c9b783493b25 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] No waiting events found dispatching network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:25:56 user nova-compute[72998]: WARNING nova.compute.manager [req-f6b12711-be80-42c7-91a1-103a6602e517 req-5932bd1f-cc73-4e00-ab44-c9b783493b25 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received unexpected event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b for instance with vm_state building and task_state spawning.
Aug 17 08:25:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-7ed5af97-1271-4bb1-95a8-c9bdd21f437c req-02b6875b-6759-43c5-8c0a-efe6c9963fdd service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updated VIF entry in instance network info cache for port e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-7ed5af97-1271-4bb1-95a8-c9bdd21f437c req-02b6875b-6759-43c5-8c0a-efe6c9963fdd service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7ed5af97-1271-4bb1-95a8-c9bdd21f437c req-02b6875b-6759-43c5-8c0a-efe6c9963fdd service nova] Releasing lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260758.1986551, 382786b5-2479-4260-8be7-e56513d85fb3 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:25:58 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] VM Resumed (Lifecycle Event)
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:25:58 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance spawned successfully.
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:25:58 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260758.2006323, 382786b5-2479-4260-8be7-e56513d85fb3 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:25:58 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] VM Started (Lifecycle Event)
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:25:58 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:25:58 user nova-compute[72998]: INFO nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:25:58 user nova-compute[72998]: INFO nova.compute.manager [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Took 6.71 seconds to build instance.
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-a23fd11c-7e8e-4818-8c2e-1eaadc022300 req-b1f7e3ca-edda-4fb5-80d6-bf6d40f68d2f service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a23fd11c-7e8e-4818-8c2e-1eaadc022300 req-b1f7e3ca-edda-4fb5-80d6-bf6d40f68d2f service nova] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a23fd11c-7e8e-4818-8c2e-1eaadc022300 req-b1f7e3ca-edda-4fb5-80d6-bf6d40f68d2f service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a23fd11c-7e8e-4818-8c2e-1eaadc022300 req-b1f7e3ca-edda-4fb5-80d6-bf6d40f68d2f service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-a23fd11c-7e8e-4818-8c2e-1eaadc022300 req-b1f7e3ca-edda-4fb5-80d6-bf6d40f68d2f service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] No waiting events found dispatching network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:25:58 user nova-compute[72998]: WARNING nova.compute.manager [req-a23fd11c-7e8e-4818-8c2e-1eaadc022300 req-b1f7e3ca-edda-4fb5-80d6-bf6d40f68d2f service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received unexpected event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b for instance with vm_state active and task_state None.
Aug 17 08:25:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3a3857e3-0791-4d8e-9ab1-60770be78c8a tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.827s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:25:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:26:00 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Creating image(s)
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Ensure instance console log exists: /opt/stack/data/nova/instances/603c6577-f34a-450d-a137-603469e19ede/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Start _get_guest_xml network_info=[{"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '48656294-bdf3-4455-892b-f40af3b06e4c', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvkbCdPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '603c6577-f34a-450d-a137-603469e19ede', 'attached_at': '', 'detached_at': '', 'volume_id': '9fb70aa3-b710-4008-951d-e0e5efb221b5', 'serial': '9fb70aa3-b710-4008-951d-e0e5efb221b5'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:26:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:26:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvkbCdPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:26:00 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:26:00 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:26:00 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eceef5d-4571-4e91-9bd7-ab4c5306d57f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:26:00 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eda6dd4-6210-4909-b10c-ec86450df253]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5] added
Aug 17 08:26:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfb71a3-d759-4285-8aa8-a940c9e8d3ee]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ae3aa4-8779-42a7-ab8f-b8a260ebd6e6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nvkbCdPJ {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nvkbCdPJ" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1c78f-2844-489a-a99b-826471b88f48]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nvkbCdPJ'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b9245-1db2-47b4-b521-9860dffaa4be]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eefa1f-1931-4c9d-98aa-120afe1a42f8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:00 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:00 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8911c48-ea2c-4d14-b93f-511b4b7cf0e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260]
Aug 17 08:26:00 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260] successful.
Aug 17 08:26:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe9567d-5984-492a-8d27-38553681a962]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde72951-b015-4c15-a4e6-8404797827eb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:00 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:00 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:00 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:00 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:00 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1132f81-8897-4715-af0b-dcf4fd49a818]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvkbCdPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:26:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23530383837626165', 'path': '/dev/sdd'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530383837626165', 'path': '/dev/sdd'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405697983',display_name='tempest-ServerActionsTestOtherA-server-1405697983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405697983',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwso8zXzyr8rdW+F3TIWTcGQW2195HR8rtDbyl+3RZbz4rT8sA0T1Nq594b2NMeWJ/ZCBUqUIDbRSEtao2k3JmymnhZIpHBjG50mdl6hk0l6mAeujcqHjcduFAXBAHWg==',key_name='tempest-keypair-622925506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-ss81oka0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=603c6577-f34a-450d-a137-603469e19ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'pci_devices' on Instance uuid 603c6577-f34a-450d-a137-603469e19ede {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:26:01 user nova-compute[72998]:   <uuid>603c6577-f34a-450d-a137-603469e19ede</uuid>
Aug 17 08:26:01 user nova-compute[72998]:   <name>instance-00000019</name>
Aug 17 08:26:01 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:26:01 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:26:01 user nova-compute[72998]:   <metadata>
Aug 17 08:26:01 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:26:01 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:26:01 user nova-compute[72998]:       <nova:name>tempest-ServerActionsTestOtherA-server-1405697983</nova:name>
Aug 17 08:26:01 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:26:00</nova:creationTime>
Aug 17 08:26:01 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:26:01 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:26:01 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:26:01 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:26:01 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:26:01 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:26:01 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:26:01 user nova-compute[72998]:       <nova:owner>
Aug 17 08:26:01 user nova-compute[72998]:         <nova:user uuid="0be579ee85cb4ac2b59812bbee48c272">tempest-ServerActionsTestOtherA-1892042619-project-member</nova:user>
Aug 17 08:26:01 user nova-compute[72998]:         <nova:project uuid="d62167eb6909402f8dca89678acff055">tempest-ServerActionsTestOtherA-1892042619</nova:project>
Aug 17 08:26:01 user nova-compute[72998]:       </nova:owner>
Aug 17 08:26:01 user nova-compute[72998]:       <nova:ports>
Aug 17 08:26:01 user nova-compute[72998]:         <nova:port uuid="726f4b3e-5fa4-4747-8f97-a1c7853bf57e">
Aug 17 08:26:01 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 08:26:01 user nova-compute[72998]:         </nova:port>
Aug 17 08:26:01 user nova-compute[72998]:       </nova:ports>
Aug 17 08:26:01 user nova-compute[72998]:     </nova:instance>
Aug 17 08:26:01 user nova-compute[72998]:   </metadata>
Aug 17 08:26:01 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:26:01 user nova-compute[72998]:     <system>
Aug 17 08:26:01 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:26:01 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:26:01 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:26:01 user nova-compute[72998]:       <entry name="serial">603c6577-f34a-450d-a137-603469e19ede</entry>
Aug 17 08:26:01 user nova-compute[72998]:       <entry name="uuid">603c6577-f34a-450d-a137-603469e19ede</entry>
Aug 17 08:26:01 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:26:01 user nova-compute[72998]:     </system>
Aug 17 08:26:01 user nova-compute[72998]:   </sysinfo>
Aug 17 08:26:01 user nova-compute[72998]:   <os>
Aug 17 08:26:01 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:26:01 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:26:01 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:26:01 user nova-compute[72998]:   </os>
Aug 17 08:26:01 user nova-compute[72998]:   <features>
Aug 17 08:26:01 user nova-compute[72998]:     <acpi/>
Aug 17 08:26:01 user nova-compute[72998]:     <apic/>
Aug 17 08:26:01 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:26:01 user nova-compute[72998]:   </features>
Aug 17 08:26:01 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:26:01 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:26:01 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:26:01 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:26:01 user nova-compute[72998]:   </clock>
Aug 17 08:26:01 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:26:01 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:26:01 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:26:01 user nova-compute[72998]:   </cpu>
Aug 17 08:26:01 user nova-compute[72998]:   <devices>
Aug 17 08:26:01 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:26:01 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:26:01 user nova-compute[72998]:       <source dev="/dev/sdd"/>
Aug 17 08:26:01 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:26:01 user nova-compute[72998]:       <serial>9fb70aa3-b710-4008-951d-e0e5efb221b5</serial>
Aug 17 08:26:01 user nova-compute[72998]:     </disk>
Aug 17 08:26:01 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:26:01 user nova-compute[72998]:       <mac address="fa:16:3e:24:5f:81"/>
Aug 17 08:26:01 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:26:01 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:26:01 user nova-compute[72998]:       <target dev="tap726f4b3e-5f"/>
Aug 17 08:26:01 user nova-compute[72998]:     </interface>
Aug 17 08:26:01 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:26:01 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/603c6577-f34a-450d-a137-603469e19ede/console.log" append="off"/>
Aug 17 08:26:01 user nova-compute[72998]:     </serial>
Aug 17 08:26:01 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:26:01 user nova-compute[72998]:     <video>
Aug 17 08:26:01 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:26:01 user nova-compute[72998]:     </video>
Aug 17 08:26:01 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:26:01 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:26:01 user nova-compute[72998]:     </rng>
Aug 17 08:26:01 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:26:01 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:26:01 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:26:01 user nova-compute[72998]:     </memballoon>
Aug 17 08:26:01 user nova-compute[72998]:   </devices>
Aug 17 08:26:01 user nova-compute[72998]: </domain>
Aug 17 08:26:01 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405697983',display_name='tempest-ServerActionsTestOtherA-server-1405697983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405697983',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwso8zXzyr8rdW+F3TIWTcGQW2195HR8rtDbyl+3RZbz4rT8sA0T1Nq594b2NMeWJ/ZCBUqUIDbRSEtao2k3JmymnhZIpHBjG50mdl6hk0l6mAeujcqHjcduFAXBAHWg==',key_name='tempest-keypair-622925506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-ss81oka0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=603c6577-f34a-450d-a137-603469e19ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG os_vif [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap726f4b3e-5f, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap726f4b3e-5f, col_values=(('external_ids', {'iface-id': '726f4b3e-5fa4-4747-8f97-a1c7853bf57e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:5f:81', 'vm-uuid': '603c6577-f34a-450d-a137-603469e19ede'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:01 user nova-compute[72998]: INFO os_vif [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f')
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No VIF found with MAC fa:16:3e:24:5f:81, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Skipping network cache update for instance because it is Building. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:26:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid e2b811f8-19a3-4b50-8ea9-6d3442c38819 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updating instance_info_cache with network_info: [{"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:26:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:26:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:26:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-810e40a1-af84-4096-bf95-1546d20afbfb req-b285d4b6-9ea2-4476-8b35-b0b5ed1eb8c4 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-810e40a1-af84-4096-bf95-1546d20afbfb req-b285d4b6-9ea2-4476-8b35-b0b5ed1eb8c4 service nova] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-810e40a1-af84-4096-bf95-1546d20afbfb req-b285d4b6-9ea2-4476-8b35-b0b5ed1eb8c4 service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-810e40a1-af84-4096-bf95-1546d20afbfb req-b285d4b6-9ea2-4476-8b35-b0b5ed1eb8c4 service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-810e40a1-af84-4096-bf95-1546d20afbfb req-b285d4b6-9ea2-4476-8b35-b0b5ed1eb8c4 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] No waiting events found dispatching network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:03 user nova-compute[72998]: WARNING nova.compute.manager [req-810e40a1-af84-4096-bf95-1546d20afbfb req-b285d4b6-9ea2-4476-8b35-b0b5ed1eb8c4 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received unexpected event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e for instance with vm_state building and task_state spawning.
Aug 17 08:26:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260765.015184, 603c6577-f34a-450d-a137-603469e19ede => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:26:05 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] VM Resumed (Lifecycle Event)
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:26:05 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] Instance spawned successfully.
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:26:05 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260765.0178301, 603c6577-f34a-450d-a137-603469e19ede => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:26:05 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] VM Started (Lifecycle Event)
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:26:05 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.compute.manager [req-650f08b1-c03e-43c2-b352-4618a98b1db2 req-9508a6ce-35fd-4639-8aab-377ca9e966f8 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-650f08b1-c03e-43c2-b352-4618a98b1db2 req-9508a6ce-35fd-4639-8aab-377ca9e966f8 service nova] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-650f08b1-c03e-43c2-b352-4618a98b1db2 req-9508a6ce-35fd-4639-8aab-377ca9e966f8 service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-650f08b1-c03e-43c2-b352-4618a98b1db2 req-9508a6ce-35fd-4639-8aab-377ca9e966f8 service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.compute.manager [req-650f08b1-c03e-43c2-b352-4618a98b1db2 req-9508a6ce-35fd-4639-8aab-377ca9e966f8 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] No waiting events found dispatching network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:05 user nova-compute[72998]: WARNING nova.compute.manager [req-650f08b1-c03e-43c2-b352-4618a98b1db2 req-9508a6ce-35fd-4639-8aab-377ca9e966f8 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received unexpected event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e for instance with vm_state building and task_state spawning.
Aug 17 08:26:05 user nova-compute[72998]: INFO nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Took 5.07 seconds to spawn the instance on the hypervisor.
Aug 17 08:26:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:05 user nova-compute[72998]: INFO nova.compute.manager [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Took 17.91 seconds to build instance.
Aug 17 08:26:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7165c8e1-92e4-4c9a-ad80-612b3884f66f tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.009s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:26:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-a916d19d-4c5f-4faa-94b0-d6e9d10a75ac req-257c4790-1aa6-44c3-a03b-58c8aac27f71 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-changed-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-a916d19d-4c5f-4faa-94b0-d6e9d10a75ac req-257c4790-1aa6-44c3-a03b-58c8aac27f71 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Refreshing instance network info cache due to event network-changed-85901016-fa8e-4d52-9229-caa63c02bea3. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a916d19d-4c5f-4faa-94b0-d6e9d10a75ac req-257c4790-1aa6-44c3-a03b-58c8aac27f71 service nova] Acquiring lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a916d19d-4c5f-4faa-94b0-d6e9d10a75ac req-257c4790-1aa6-44c3-a03b-58c8aac27f71 service nova] Acquired lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-a916d19d-4c5f-4faa-94b0-d6e9d10a75ac req-257c4790-1aa6-44c3-a03b-58c8aac27f71 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Refreshing network info cache for port 85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG nova.network.neutron [req-a916d19d-4c5f-4faa-94b0-d6e9d10a75ac req-257c4790-1aa6-44c3-a03b-58c8aac27f71 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updated VIF entry in instance network info cache for port 85901016-fa8e-4d52-9229-caa63c02bea3. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG nova.network.neutron [req-a916d19d-4c5f-4faa-94b0-d6e9d10a75ac req-257c4790-1aa6-44c3-a03b-58c8aac27f71 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updating instance_info_cache with network_info: [{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a916d19d-4c5f-4faa-94b0-d6e9d10a75ac req-257c4790-1aa6-44c3-a03b-58c8aac27f71 service nova] Releasing lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.287s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:26:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:26:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:26:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:26:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7604MB free_disk=24.225528717041016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:26:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8067a647-dca0-47d4-a472-eac43a2e4de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8b55bd93-be1c-4b78-ab1a-adba05d5efde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 603c6577-f34a-450d-a137-603469e19ede actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 382786b5-2479-4260-8be7-e56513d85fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:26:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-628d34bd-a803-4973-b4c8-b87bdc913de7 req-1fc3c03c-5256-4dce-b1d4-4ef10f5927a0 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received event network-changed-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-628d34bd-a803-4973-b4c8-b87bdc913de7 req-1fc3c03c-5256-4dce-b1d4-4ef10f5927a0 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Refreshing instance network info cache due to event network-changed-c1f346f0-ef4e-4cee-82b3-fe22060c58fb. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-628d34bd-a803-4973-b4c8-b87bdc913de7 req-1fc3c03c-5256-4dce-b1d4-4ef10f5927a0 service nova] Acquiring lock "refresh_cache-8b55bd93-be1c-4b78-ab1a-adba05d5efde" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-628d34bd-a803-4973-b4c8-b87bdc913de7 req-1fc3c03c-5256-4dce-b1d4-4ef10f5927a0 service nova] Acquired lock "refresh_cache-8b55bd93-be1c-4b78-ab1a-adba05d5efde" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG nova.network.neutron [req-628d34bd-a803-4973-b4c8-b87bdc913de7 req-1fc3c03c-5256-4dce-b1d4-4ef10f5927a0 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Refreshing network info cache for port c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG nova.objects.instance [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'flavor' on Instance uuid 8b55bd93-be1c-4b78-ab1a-adba05d5efde {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:13 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Ignoring supplied device name: /dev/vdb
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:13 user nova-compute[72998]: INFO nova.compute.manager [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Attaching volume 4dc73c60-2418-4ffd-ae59-7c6d0a4debda to /dev/vdb
Aug 17 08:26:13 user nova-compute[72998]: DEBUG os_brick.utils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG nova.network.neutron [req-628d34bd-a803-4973-b4c8-b87bdc913de7 req-1fc3c03c-5256-4dce-b1d4-4ef10f5927a0 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Updated VIF entry in instance network info cache for port c1f346f0-ef4e-4cee-82b3-fe22060c58fb. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG nova.network.neutron [req-628d34bd-a803-4973-b4c8-b87bdc913de7 req-1fc3c03c-5256-4dce-b1d4-4ef10f5927a0 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Updating instance_info_cache with network_info: [{"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-628d34bd-a803-4973-b4c8-b87bdc913de7 req-1fc3c03c-5256-4dce-b1d4-4ef10f5927a0 service nova] Releasing lock "refresh_cache-8b55bd93-be1c-4b78-ab1a-adba05d5efde" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d127c93d-c9f9-470e-88ec-91b8246c7932]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0d1e05-9bde-4289-bba6-baa2960761df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d70b55-bc70-469b-b3ea-89fdeff5bd83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[400ab114-c009-481b-b8c1-a1175574790f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:26:13 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a31328-1fea-4f09-9eaf-6587f2959519]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG os_brick.utils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Updating existing volume attachment record: d9d8c41f-f8e7-4d41-bdb2-073991e47c3f {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:14 user nova-compute[72998]: INFO nova.compute.manager [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Attaching volume 4d238b32-97a2-429c-9d30-6ce0a87a2986 to /dev/vdb
Aug 17 08:26:14 user nova-compute[72998]: DEBUG os_brick.utils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[677324c7-83fc-4973-b5dd-cf58b57687ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f1f5f3-2135-47e6-8ff9-1c6edbb3c672]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f56239-27ff-4962-98f6-7340747deaa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af21e76-ad94-4903-8b42-f3803da43ce9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:26:14 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:26:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ded82-35eb-467a-ba52-e980b58974bf]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG os_brick.utils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:26:14 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updating existing volume attachment record: beb12b95-1a16-4574-bdec-6d86c5dd1c47 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:26:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfCDbSJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:26:25 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:26:25 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:26:25 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:26:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c73cec-bba4-4b5b-b245-240f17eccfc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:26:25 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725f479-2857-4ec9-bf62-6ed83823473f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda] added
Aug 17 08:26:25 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee633df-56ce-43d5-a4e4-4092b6c89192]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1350afd5-bb92-4b09-80be-71fffaa9719a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfCDbSJh {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfCDbSJh" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5903ba-61bf-4995-9dd5-9fb8db095352]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfCDbSJh'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnTEULqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:26:25 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e292f2d7-5e0b-49fd-94b8-f545a0664885]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a90c370-ac13-4ae3-828d-2da46f5d4c5b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:25 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:25 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:25 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:25 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:25 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:25 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:26:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b26de4-dc27-474a-a965-b5d67a67be10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda, portal: 172.16.0.220,3260]
Aug 17 08:26:26 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda, portal: 172.16.0.220,3260] successful.
Aug 17 08:26:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7722bd-406e-4ddb-80a8-2612a36bab30]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d124e3-c9f5-4fe6-a429-5c6572202078]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:26 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:26 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:26 user nova-compute[72998]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)
Aug 17 08:26:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:26 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:26 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:26 user nova-compute[72998]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)
Aug 17 08:26:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af4163c-39ca-4331-b424-96d9e6006aaf]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfCDbSJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:26:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23934356539643561', 'path': '/dev/sde'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934356539643561', 'path': '/dev/sde'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.208s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:26:27 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:26:27 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG nova.objects.instance [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'flavor' on Instance uuid 8b55bd93-be1c-4b78-ab1a-adba05d5efde {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eeb0d0-5908-4497-8966-00dba9d0cd4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:26:27 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:26:27 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:26:27 user nova-compute[72998]:   <source dev="/dev/sde"/>
Aug 17 08:26:27 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:26:27 user nova-compute[72998]:   <serial>4dc73c60-2418-4ffd-ae59-7c6d0a4debda</serial>
Aug 17 08:26:27 user nova-compute[72998]: </disk>
Aug 17 08:26:27 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[db753f26-3c11-47ea-9266-9bae0b08f8a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986] added
Aug 17 08:26:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4608bf54-7a68-4ece-b4d1-2feba0962522]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ffb14-0acb-481a-8a9c-e7b07a32a0ef]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnTEULqa {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnTEULqa" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ae780-3d3b-4e4d-bc4b-3ffa798d93a1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnTEULqa'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeeb4a4-b65c-4ec9-bdd6-56ad189a90f7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a37652-aa6b-41e0-87e4-b9703b6a5d9c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)
Aug 17 08:26:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)
Aug 17 08:26:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c9268a-6b1a-4ffa-9d70-14d053cb4e8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260]
Aug 17 08:26:27 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260] successful.
Aug 17 08:26:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d205fa5e-2dd8-4ad5-96b7-0f90cd61272e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2d96fc-9d9c-49a9-8616-ce43b522a343]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)
Aug 17 08:26:27 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:26:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d9c038-0d56-493d-a4ee-86085d6896b6]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnTEULqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No VIF found with MAC fa:16:3e:98:9f:5b, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:26:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-daa4a0b7-9fa3-46b8-93f9-f8ee1a128210 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.160s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:26:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== connect_volume: return (2560ms) {'type': 'block', 'scsi_wwn': '26163346661636131', 'path': '/dev/sdf'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:26:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163346661636131', 'path': '/dev/sdf'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:26:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:26:28 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:26:28 user nova-compute[72998]:   <source dev="/dev/sdf"/>
Aug 17 08:26:28 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:26:28 user nova-compute[72998]:   <serial>4d238b32-97a2-429c-9d30-6ce0a87a2986</serial>
Aug 17 08:26:28 user nova-compute[72998]: </disk>
Aug 17 08:26:28 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:26:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:26:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:26:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No VIF found with MAC fa:16:3e:9c:31:a6, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3da0a5d2-4da0-44f1-ac1a-cbe984a48ed2 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.010s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fdcd4e39-9fde-4de2-b65a-5ef5886ad69c tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fdcd4e39-9fde-4de2-b65a-5ef5886ad69c tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fdcd4e39-9fde-4de2-b65a-5ef5886ad69c tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fdcd4e39-9fde-4de2-b65a-5ef5886ad69c tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72998) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fdcd4e39-9fde-4de2-b65a-5ef5886ad69c tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:30 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance destroyed successfully.
Aug 17 08:26:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fdcd4e39-9fde-4de2-b65a-5ef5886ad69c tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fdcd4e39-9fde-4de2-b65a-5ef5886ad69c tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.907s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-2c6fcbd6-d553-4c5d-9f52-7e678b64ea3b req-67a3f82b-1f0a-4e92-ac1b-d2fbf9f205ac service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-unplugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2c6fcbd6-d553-4c5d-9f52-7e678b64ea3b req-67a3f82b-1f0a-4e92-ac1b-d2fbf9f205ac service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2c6fcbd6-d553-4c5d-9f52-7e678b64ea3b req-67a3f82b-1f0a-4e92-ac1b-d2fbf9f205ac service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2c6fcbd6-d553-4c5d-9f52-7e678b64ea3b req-67a3f82b-1f0a-4e92-ac1b-d2fbf9f205ac service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-2c6fcbd6-d553-4c5d-9f52-7e678b64ea3b req-67a3f82b-1f0a-4e92-ac1b-d2fbf9f205ac service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-unplugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:33 user nova-compute[72998]: WARNING nova.compute.manager [req-2c6fcbd6-d553-4c5d-9f52-7e678b64ea3b req-67a3f82b-1f0a-4e92-ac1b-d2fbf9f205ac service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-unplugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state stopped and task_state None.
Aug 17 08:26:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:26:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:34 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:26:34 user nova-compute[72998]: INFO nova.compute.claims [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Claim successful on node user
Aug 17 08:26:34 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:26:34 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:26:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:26:35 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.policy [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1165511c08f4cb08358007fed3c2e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310f3d4efad24fe59257fdc9be8723d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:26:35 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Creating image(s)
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "/opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "/opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-bcba7c25-aa63-41ac-9d0e-c29032c70d92 req-caa51f88-9071-4c3f-bbcf-aa38da6b35d3 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bcba7c25-aa63-41ac-9d0e-c29032c70d92 req-caa51f88-9071-4c3f-bbcf-aa38da6b35d3 service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bcba7c25-aa63-41ac-9d0e-c29032c70d92 req-caa51f88-9071-4c3f-bbcf-aa38da6b35d3 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bcba7c25-aa63-41ac-9d0e-c29032c70d92 req-caa51f88-9071-4c3f-bbcf-aa38da6b35d3 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-bcba7c25-aa63-41ac-9d0e-c29032c70d92 req-caa51f88-9071-4c3f-bbcf-aa38da6b35d3 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:35 user nova-compute[72998]: WARNING nova.compute.manager [req-bcba7c25-aa63-41ac-9d0e-c29032c70d92 req-caa51f88-9071-4c3f-bbcf-aa38da6b35d3 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state stopped and task_state None.
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.170s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk 1073741824" returned: 0 in 0.047s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Successfully created port: 2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Cannot resize image /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lazy-loading 'migration_context' on Instance uuid d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Ensure instance console log exists: /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:36 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Successfully updated port: 2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:26:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "refresh_cache-d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:26:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquired lock "refresh_cache-d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:26:36 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:26:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-42c9d95e-c839-4d3c-ac5f-27fd67ed012c req-05d56a0f-f727-410a-ad90-f9124295f383 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received event network-changed-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-42c9d95e-c839-4d3c-ac5f-27fd67ed012c req-05d56a0f-f727-410a-ad90-f9124295f383 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Refreshing instance network info cache due to event network-changed-2fa1dce5-d780-4012-82ca-279d4f2bdb16. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:26:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-42c9d95e-c839-4d3c-ac5f-27fd67ed012c req-05d56a0f-f727-410a-ad90-f9124295f383 service nova] Acquiring lock "refresh_cache-d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:26:36 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:26:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Updating instance_info_cache with network_info: [{"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Releasing lock "refresh_cache-d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Instance network_info: |[{"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-42c9d95e-c839-4d3c-ac5f-27fd67ed012c req-05d56a0f-f727-410a-ad90-f9124295f383 service nova] Acquired lock "refresh_cache-d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-42c9d95e-c839-4d3c-ac5f-27fd67ed012c req-05d56a0f-f727-410a-ad90-f9124295f383 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Refreshing network info cache for port 2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Start _get_guest_xml network_info=[{"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:26:37 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:26:37 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-671479913',display_name='tempest-VolumesActionsTest-instance-671479913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-671479913',id=27,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='310f3d4efad24fe59257fdc9be8723d7',ramdisk_id='',reservation_id='r-nda62qwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-188754561',owner_user_name='tempest-VolumesActionsTest-188754561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:26:35Z,user_data=None,user_id='d1165511c08f4cb08358007fed3c2e5b',uuid=d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converting VIF {"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:d4,bridge_name='br-int',has_traffic_filtering=True,id=2fa1dce5-d780-4012-82ca-279d4f2bdb16,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa1dce5-d7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lazy-loading 'pci_devices' on Instance uuid d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:26:37 user nova-compute[72998]:   <uuid>d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0</uuid>
Aug 17 08:26:37 user nova-compute[72998]:   <name>instance-0000001b</name>
Aug 17 08:26:37 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:26:37 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:26:37 user nova-compute[72998]:   <metadata>
Aug 17 08:26:37 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:26:37 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:26:37 user nova-compute[72998]:       <nova:name>tempest-VolumesActionsTest-instance-671479913</nova:name>
Aug 17 08:26:37 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:26:37</nova:creationTime>
Aug 17 08:26:37 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:26:37 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:26:37 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:26:37 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:26:37 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:26:37 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:26:37 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:26:37 user nova-compute[72998]:       <nova:owner>
Aug 17 08:26:37 user nova-compute[72998]:         <nova:user uuid="d1165511c08f4cb08358007fed3c2e5b">tempest-VolumesActionsTest-188754561-project-member</nova:user>
Aug 17 08:26:37 user nova-compute[72998]:         <nova:project uuid="310f3d4efad24fe59257fdc9be8723d7">tempest-VolumesActionsTest-188754561</nova:project>
Aug 17 08:26:37 user nova-compute[72998]:       </nova:owner>
Aug 17 08:26:37 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:26:37 user nova-compute[72998]:       <nova:ports>
Aug 17 08:26:37 user nova-compute[72998]:         <nova:port uuid="2fa1dce5-d780-4012-82ca-279d4f2bdb16">
Aug 17 08:26:37 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 08:26:37 user nova-compute[72998]:         </nova:port>
Aug 17 08:26:37 user nova-compute[72998]:       </nova:ports>
Aug 17 08:26:37 user nova-compute[72998]:     </nova:instance>
Aug 17 08:26:37 user nova-compute[72998]:   </metadata>
Aug 17 08:26:37 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:26:37 user nova-compute[72998]:     <system>
Aug 17 08:26:37 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:26:37 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:26:37 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:26:37 user nova-compute[72998]:       <entry name="serial">d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0</entry>
Aug 17 08:26:37 user nova-compute[72998]:       <entry name="uuid">d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0</entry>
Aug 17 08:26:37 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:26:37 user nova-compute[72998]:     </system>
Aug 17 08:26:37 user nova-compute[72998]:   </sysinfo>
Aug 17 08:26:37 user nova-compute[72998]:   <os>
Aug 17 08:26:37 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:26:37 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:26:37 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:26:37 user nova-compute[72998]:   </os>
Aug 17 08:26:37 user nova-compute[72998]:   <features>
Aug 17 08:26:37 user nova-compute[72998]:     <acpi/>
Aug 17 08:26:37 user nova-compute[72998]:     <apic/>
Aug 17 08:26:37 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:26:37 user nova-compute[72998]:   </features>
Aug 17 08:26:37 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:26:37 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:26:37 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:26:37 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:26:37 user nova-compute[72998]:   </clock>
Aug 17 08:26:37 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:26:37 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:26:37 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:26:37 user nova-compute[72998]:   </cpu>
Aug 17 08:26:37 user nova-compute[72998]:   <devices>
Aug 17 08:26:37 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:26:37 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:26:37 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk"/>
Aug 17 08:26:37 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:26:37 user nova-compute[72998]:     </disk>
Aug 17 08:26:37 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:26:37 user nova-compute[72998]:       <mac address="fa:16:3e:7c:6e:d4"/>
Aug 17 08:26:37 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:26:37 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:26:37 user nova-compute[72998]:       <target dev="tap2fa1dce5-d7"/>
Aug 17 08:26:37 user nova-compute[72998]:     </interface>
Aug 17 08:26:37 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:26:37 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/console.log" append="off"/>
Aug 17 08:26:37 user nova-compute[72998]:     </serial>
Aug 17 08:26:37 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:26:37 user nova-compute[72998]:     <video>
Aug 17 08:26:37 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:26:37 user nova-compute[72998]:     </video>
Aug 17 08:26:37 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:26:37 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:26:37 user nova-compute[72998]:     </rng>
Aug 17 08:26:37 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:26:37 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:26:37 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:26:37 user nova-compute[72998]:     </memballoon>
Aug 17 08:26:37 user nova-compute[72998]:   </devices>
Aug 17 08:26:37 user nova-compute[72998]: </domain>
Aug 17 08:26:37 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-671479913',display_name='tempest-VolumesActionsTest-instance-671479913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-671479913',id=27,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='310f3d4efad24fe59257fdc9be8723d7',ramdisk_id='',reservation_id='r-nda62qwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-188754561',owner_user_name='tempest-VolumesActionsTest-188754561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:26:35Z,user_data=None,user_id='d1165511c08f4cb08358007fed3c2e5b',uuid=d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converting VIF {"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:d4,bridge_name='br-int',has_traffic_filtering=True,id=2fa1dce5-d780-4012-82ca-279d4f2bdb16,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa1dce5-d7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG os_vif [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:d4,bridge_name='br-int',has_traffic_filtering=True,id=2fa1dce5-d780-4012-82ca-279d4f2bdb16,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa1dce5-d7') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fa1dce5-d7, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fa1dce5-d7, col_values=(('external_ids', {'iface-id': '2fa1dce5-d780-4012-82ca-279d4f2bdb16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:6e:d4', 'vm-uuid': 'd0e2d0a3-0ff1-4098-9f14-f1235eea9ff0'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:37 user nova-compute[72998]: INFO os_vif [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:d4,bridge_name='br-int',has_traffic_filtering=True,id=2fa1dce5-d780-4012-82ca-279d4f2bdb16,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa1dce5-d7')
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] No VIF found with MAC fa:16:3e:7c:6e:d4, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-42c9d95e-c839-4d3c-ac5f-27fd67ed012c req-05d56a0f-f727-410a-ad90-f9124295f383 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Updated VIF entry in instance network info cache for port 2fa1dce5-d780-4012-82ca-279d4f2bdb16. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-42c9d95e-c839-4d3c-ac5f-27fd67ed012c req-05d56a0f-f727-410a-ad90-f9124295f383 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Updating instance_info_cache with network_info: [{"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:26:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-42c9d95e-c839-4d3c-ac5f-27fd67ed012c req-05d56a0f-f727-410a-ad90-f9124295f383 service nova] Releasing lock "refresh_cache-d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:26:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-6a0f1470-72aa-4c04-ac38-ed38003ac875 req-772b6374-d370-4817-84ea-e22b7759c82b service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received event network-vif-plugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6a0f1470-72aa-4c04-ac38-ed38003ac875 req-772b6374-d370-4817-84ea-e22b7759c82b service nova] Acquiring lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6a0f1470-72aa-4c04-ac38-ed38003ac875 req-772b6374-d370-4817-84ea-e22b7759c82b service nova] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6a0f1470-72aa-4c04-ac38-ed38003ac875 req-772b6374-d370-4817-84ea-e22b7759c82b service nova] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-6a0f1470-72aa-4c04-ac38-ed38003ac875 req-772b6374-d370-4817-84ea-e22b7759c82b service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] No waiting events found dispatching network-vif-plugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:38 user nova-compute[72998]: WARNING nova.compute.manager [req-6a0f1470-72aa-4c04-ac38-ed38003ac875 req-772b6374-d370-4817-84ea-e22b7759c82b service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received unexpected event network-vif-plugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 for instance with vm_state building and task_state spawning.
Aug 17 08:26:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260800.6189048, d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:26:40 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] VM Resumed (Lifecycle Event)
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:26:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Instance spawned successfully.
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:26:40 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260800.6201744, d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:26:40 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] VM Started (Lifecycle Event)
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:26:40 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:26:40 user nova-compute[72998]: INFO nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-8990691e-0d88-4e85-8ab3-3ace17c36b24 req-abbee1ad-dd47-434c-91c1-b0ff6d52f345 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received event network-vif-plugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8990691e-0d88-4e85-8ab3-3ace17c36b24 req-abbee1ad-dd47-434c-91c1-b0ff6d52f345 service nova] Acquiring lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8990691e-0d88-4e85-8ab3-3ace17c36b24 req-abbee1ad-dd47-434c-91c1-b0ff6d52f345 service nova] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8990691e-0d88-4e85-8ab3-3ace17c36b24 req-abbee1ad-dd47-434c-91c1-b0ff6d52f345 service nova] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-8990691e-0d88-4e85-8ab3-3ace17c36b24 req-abbee1ad-dd47-434c-91c1-b0ff6d52f345 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] No waiting events found dispatching network-vif-plugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:40 user nova-compute[72998]: WARNING nova.compute.manager [req-8990691e-0d88-4e85-8ab3-3ace17c36b24 req-abbee1ad-dd47-434c-91c1-b0ff6d52f345 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received unexpected event network-vif-plugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 for instance with vm_state building and task_state spawning.
Aug 17 08:26:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:40 user nova-compute[72998]: INFO nova.compute.manager [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Took 6.26 seconds to build instance.
Aug 17 08:26:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ce74635-9299-4426-a54c-866bc0d2da6d tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.391s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:42 user nova-compute[72998]: INFO nova.compute.manager [None req-5b726502-1ffb-4d14-8b3a-ab25df94fa97 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Unrescuing
Aug 17 08:26:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b726502-1ffb-4d14-8b3a-ab25df94fa97 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:26:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b726502-1ffb-4d14-8b3a-ab25df94fa97 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquired lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:26:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5b726502-1ffb-4d14-8b3a-ab25df94fa97 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5b726502-1ffb-4d14-8b3a-ab25df94fa97 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updating instance_info_cache with network_info: [{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b726502-1ffb-4d14-8b3a-ab25df94fa97 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Releasing lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG nova.objects.instance [None req-5b726502-1ffb-4d14-8b3a-ab25df94fa97 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'flavor' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-6518b9d6-593f-4918-b7f8-f4286b7b6893 req-e2bdbd65-5bae-41c4-a3c3-7ceb9542d98f service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-unplugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6518b9d6-593f-4918-b7f8-f4286b7b6893 req-e2bdbd65-5bae-41c4-a3c3-7ceb9542d98f service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6518b9d6-593f-4918-b7f8-f4286b7b6893 req-e2bdbd65-5bae-41c4-a3c3-7ceb9542d98f service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6518b9d6-593f-4918-b7f8-f4286b7b6893 req-e2bdbd65-5bae-41c4-a3c3-7ceb9542d98f service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-6518b9d6-593f-4918-b7f8-f4286b7b6893 req-e2bdbd65-5bae-41c4-a3c3-7ceb9542d98f service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-unplugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:43 user nova-compute[72998]: WARNING nova.compute.manager [req-6518b9d6-593f-4918-b7f8-f4286b7b6893 req-e2bdbd65-5bae-41c4-a3c3-7ceb9542d98f service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-unplugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:26:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:43 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Instance destroyed successfully.
Aug 17 08:26:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260790.2814517, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:26:45 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] VM Stopped (Lifecycle Event)
Aug 17 08:26:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a2c6ea4e-2528-44a2-857d-b571d62545c6 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a2c6ea4e-2528-44a2-857d-b571d62545c6 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:45 user nova-compute[72998]: WARNING nova.compute.manager [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:26:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:45 user nova-compute[72998]: WARNING nova.compute.manager [req-9512614a-bf6d-46db-8874-cb9f07ada330 req-6ea6ea0b-b08b-490f-9fd4-91cced8ff8b1 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:26:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for 8067a647-dca0-47d4-a472-eac43a2e4de6 due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260807.3809705, 8067a647-dca0-47d4-a472-eac43a2e4de6 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:26:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] VM Resumed (Lifecycle Event)
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5b726502-1ffb-4d14-8b3a-ab25df94fa97 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:26:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260807.3827572, 8067a647-dca0-47d4-a472-eac43a2e4de6 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:26:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] VM Started (Lifecycle Event)
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-fa66f45f-4f77-4833-a62d-c5622c6591d9 req-ad839d46-6d72-49cf-9784-22e85bbe1dbf service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fa66f45f-4f77-4833-a62d-c5622c6591d9 req-ad839d46-6d72-49cf-9784-22e85bbe1dbf service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fa66f45f-4f77-4833-a62d-c5622c6591d9 req-ad839d46-6d72-49cf-9784-22e85bbe1dbf service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fa66f45f-4f77-4833-a62d-c5622c6591d9 req-ad839d46-6d72-49cf-9784-22e85bbe1dbf service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-fa66f45f-4f77-4833-a62d-c5622c6591d9 req-ad839d46-6d72-49cf-9784-22e85bbe1dbf service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:26:47 user nova-compute[72998]: WARNING nova.compute.manager [req-fa66f45f-4f77-4833-a62d-c5622c6591d9 req-ad839d46-6d72-49cf-9784-22e85bbe1dbf service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:26:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:26:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:26:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:27:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:27:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:27:03 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updating instance_info_cache with network_info: [{"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-0d992c9b-66c8-4bd9-b78e-51e13d662144" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:27:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:27:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:27:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:13 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:27:13 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:27:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7369MB free_disk=24.165668487548828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:13 user nova-compute[72998]: INFO nova.compute.manager [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Detaching volume 4dc73c60-2418-4ffd-ae59-7c6d0a4debda
Aug 17 08:27:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:13 user nova-compute[72998]: INFO nova.virt.block_device [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Attempting to driver detach volume 4dc73c60-2418-4ffd-ae59-7c6d0a4debda from mountpoint /dev/vdb
Aug 17 08:27:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Attempting to detach device vdb from instance 8b55bd93-be1c-4b78-ab1a-adba05d5efde from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:27:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:27:13 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:27:13 user nova-compute[72998]:   <source dev="/dev/sde"/>
Aug 17 08:27:13 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:27:13 user nova-compute[72998]:   <serial>4dc73c60-2418-4ffd-ae59-7c6d0a4debda</serial>
Aug 17 08:27:13 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:27:13 user nova-compute[72998]: </disk>
Aug 17 08:27:13 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:27:14 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Successfully detached device vdb from instance 8b55bd93-be1c-4b78-ab1a-adba05d5efde from the persistent domain config.
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b55bd93-be1c-4b78-ab1a-adba05d5efde from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:27:14 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:27:14 user nova-compute[72998]:   <source dev="/dev/sde"/>
Aug 17 08:27:14 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:27:14 user nova-compute[72998]:   <serial>4dc73c60-2418-4ffd-ae59-7c6d0a4debda</serial>
Aug 17 08:27:14 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:27:14 user nova-compute[72998]: </disk>
Aug 17 08:27:14 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8067a647-dca0-47d4-a472-eac43a2e4de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8b55bd93-be1c-4b78-ab1a-adba05d5efde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 603c6577-f34a-450d-a137-603469e19ede actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 382786b5-2479-4260-8be7-e56513d85fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260834.480143, 8b55bd93-be1c-4b78-ab1a-adba05d5efde => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b55bd93-be1c-4b78-ab1a-adba05d5efde {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:27:14 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Successfully detached device vdb from instance 8b55bd93-be1c-4b78-ab1a-adba05d5efde from the live domain config.
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfCDbSJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:27:14 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[79161c2f-08f8-4743-b608-164105e388b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[574c0bc7-409d-4323-928d-04b98bbfd578]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:14 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:14 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:14 user nova-compute[72998]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)
Aug 17 08:27:14 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:14 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:14 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:14 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:14 user nova-compute[72998]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda (non-flash)
Aug 17 08:27:14 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:14 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4882027a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda'): ({'sde'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Removing single pathed devices sde {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc65e70-ae19-4719-b95c-3cd7270ae5f4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1cf07c-e8ec-4e99-99bb-23339c4e8e16]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Flushing IO for device /dev/sde {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2282d3dd-bd00-4e80-9d7c-ba3b3a222708]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2febb502-f8a4-42b4-9f19-cd70dd39a35c]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16d44c9-cd68-47a3-af55-5983c75758b9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[297bd0be-d969-4e67-ad23-5baee213b742]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda, portal: 172.16.0.220,3260]
Aug 17 08:27:14 user nova-compute[72998]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda, portal: 172.16.0.220,3260] successful.
Aug 17 08:27:14 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c828fd-aec0-469e-9c15-de944a3a6447]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] <== disconnect_volume: return (288ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:27:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'flavor' on Instance uuid 8b55bd93-be1c-4b78-ab1a-adba05d5efde {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4ff157bc-c361-43aa-ba64-0b1dab1dbc98 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.715s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.691s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:15 user nova-compute[72998]: INFO nova.compute.manager [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Terminating instance
Aug 17 08:27:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-b98802ba-e993-4c18-90b9-ca745db8b2ba req-058b1d6a-5df3-4bef-92df-d0679fe2c767 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received event network-vif-unplugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b98802ba-e993-4c18-90b9-ca745db8b2ba req-058b1d6a-5df3-4bef-92df-d0679fe2c767 service nova] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b98802ba-e993-4c18-90b9-ca745db8b2ba req-058b1d6a-5df3-4bef-92df-d0679fe2c767 service nova] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b98802ba-e993-4c18-90b9-ca745db8b2ba req-058b1d6a-5df3-4bef-92df-d0679fe2c767 service nova] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-b98802ba-e993-4c18-90b9-ca745db8b2ba req-058b1d6a-5df3-4bef-92df-d0679fe2c767 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] No waiting events found dispatching network-vif-unplugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-b98802ba-e993-4c18-90b9-ca745db8b2ba req-058b1d6a-5df3-4bef-92df-d0679fe2c767 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received event network-vif-unplugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:16 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Instance destroyed successfully.
Aug 17 08:27:16 user nova-compute[72998]: DEBUG nova.objects.instance [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'resources' on Instance uuid 8b55bd93-be1c-4b78-ab1a-adba05d5efde {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1657475901',display_name='tempest-VolumesSnapshotTestJSON-instance-1657475901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1657475901',id=23,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBU1NTP3xE2ieGrCcVMXPgypdK/lAEvWQphigZAWkHBKwbND/EXft4MkV4wfzpv3LK/9amRRGwVgp5HXAZ2LxONP7ytJFOAfPSy8L5oSDyRMS7Pf3N2RRwPbuSsUttpziA==',key_name='tempest-keypair-145777980',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6c1ee7c1e04088ae7a3e952743576c',ramdisk_id='',reservation_id='r-9t48mn6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-20738309',owner_user_name='tempest-VolumesSnapshotTestJSON-20738309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:24:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='963659ce0d9c4e04bf345d4a98080e89',uuid=8b55bd93-be1c-4b78-ab1a-adba05d5efde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converting VIF {"id": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "address": "fa:16:3e:98:9f:5b", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f346f0-ef", "ovs_interfaceid": "c1f346f0-ef4e-4cee-82b3-fe22060c58fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9f:5b,bridge_name='br-int',has_traffic_filtering=True,id=c1f346f0-ef4e-4cee-82b3-fe22060c58fb,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f346f0-ef') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_vif [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9f:5b,bridge_name='br-int',has_traffic_filtering=True,id=c1f346f0-ef4e-4cee-82b3-fe22060c58fb,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f346f0-ef') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1f346f0-ef, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:16 user nova-compute[72998]: INFO os_vif [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9f:5b,bridge_name='br-int',has_traffic_filtering=True,id=c1f346f0-ef4e-4cee-82b3-fe22060c58fb,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f346f0-ef')
Aug 17 08:27:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfCDbSJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:27:16 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc73c60-2418-4ffd-ae59-7c6d0a4debda', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f15d8e-43a2-495b-83ee-664b2797b7a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e45dd6-3b4d-48bc-93a4-234f9d0fc9a5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:16 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:16 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:16 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:16 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:16 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:16 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:16 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:16 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464cc5510>, {}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Disconnecting from: [] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] <== disconnect_volume: return (52ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:27:16 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Deleting instance files /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde_del
Aug 17 08:27:16 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Deletion of /opt/stack/data/nova/instances/8b55bd93-be1c-4b78-ab1a-adba05d5efde_del complete
Aug 17 08:27:16 user nova-compute[72998]: INFO nova.compute.manager [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 08:27:16 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:27:16 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:27:17 user nova-compute[72998]: INFO nova.compute.manager [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Rescuing
Aug 17 08:27:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquired lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:27:17 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:17 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Took 1.08 seconds to deallocate network for instance.
Aug 17 08:27:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-0d7128cf-7b11-4d77-8f7a-81b51c58fe4b req-58ea6e87-c54c-4c3a-9ef2-2e0f6c83b76e service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received event network-vif-deleted-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:17 user nova-compute[72998]: WARNING nova.volume.cinder [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Attachment d9d8c41f-f8e7-4d41-bdb2-073991e47c3f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d9d8c41f-f8e7-4d41-bdb2-073991e47c3f. (HTTP 404) (Request-ID: req-f5a1fe8b-70c0-48b3-a433-61b0a869dbca)
Aug 17 08:27:17 user nova-compute[72998]: INFO nova.compute.manager [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 08:27:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-983a8b96-10e6-4b28-b032-b03b5da26bf8 req-f2b8dcaa-5aa1-495e-9862-277384aeb193 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received event network-vif-plugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-983a8b96-10e6-4b28-b032-b03b5da26bf8 req-f2b8dcaa-5aa1-495e-9862-277384aeb193 service nova] Acquiring lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-983a8b96-10e6-4b28-b032-b03b5da26bf8 req-f2b8dcaa-5aa1-495e-9862-277384aeb193 service nova] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-983a8b96-10e6-4b28-b032-b03b5da26bf8 req-f2b8dcaa-5aa1-495e-9862-277384aeb193 service nova] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-983a8b96-10e6-4b28-b032-b03b5da26bf8 req-f2b8dcaa-5aa1-495e-9862-277384aeb193 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] No waiting events found dispatching network-vif-plugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:17 user nova-compute[72998]: WARNING nova.compute.manager [req-983a8b96-10e6-4b28-b032-b03b5da26bf8 req-f2b8dcaa-5aa1-495e-9862-277384aeb193 service nova] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Received unexpected event network-vif-plugged-c1f346f0-ef4e-4cee-82b3-fe22060c58fb for instance with vm_state deleted and task_state None.
Aug 17 08:27:18 user nova-compute[72998]: DEBUG nova.network.neutron [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updating instance_info_cache with network_info: [{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:18 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:27:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Releasing lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:18 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:27:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:18 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Deleted allocations for instance 8b55bd93-be1c-4b78-ab1a-adba05d5efde
Aug 17 08:27:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-50b9e39d-b736-4d4b-b105-203728cf4990 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "8b55bd93-be1c-4b78-ab1a-adba05d5efde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.676s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:18 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Instance destroyed successfully.
Aug 17 08:27:18 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Attempting a stable device rescue
Aug 17 08:27:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72998) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 08:27:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Instance directory exists: not creating {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 08:27:19 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Creating image(s)
Aug 17 08:27:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "/opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "/opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "/opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:19 user nova-compute[72998]: DEBUG nova.objects.instance [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'trusted_certs' on Instance uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "3e868dd7147c73b94073c8aa19fb938f80697569" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "3e868dd7147c73b94073c8aa19fb938f80697569" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-unplugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-unplugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:20 user nova-compute[72998]: WARNING nova.compute.manager [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-unplugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state active and task_state rescuing.
Aug 17 08:27:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:20 user nova-compute[72998]: WARNING nova.compute.manager [req-2e860d92-0094-4ab8-8653-39d87c4ac5b7 req-0233d251-fa85-4041-a7fa-6b518fae4760 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state active and task_state rescuing.
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569.part --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG nova.virt.images [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] d8bddc02-e28f-4f6b-8fe1-06f6d1b64bc6 was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569.part /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569.part /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569.converted" returned: 0 in 0.318s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "3e868dd7147c73b94073c8aa19fb938f80697569" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.786s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "3e868dd7147c73b94073c8aa19fb938f80697569" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "3e868dd7147c73b94073c8aa19fb938f80697569" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569 --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569,backing_fmt=raw /opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.rescue {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569,backing_fmt=raw /opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.rescue" returned: 0 in 0.049s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "3e868dd7147c73b94073c8aa19fb938f80697569" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'migration_context' on Instance uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Start _get_guest_xml network_info=[{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "vif_mac": "fa:16:3e:7c:6f:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd8bddc02-e28f-4f6b-8fe1-06f6d1b64bc6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e71bf72e-6825-479c-8abb-607c8ae71e6f', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnBVzviS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd87b6f0b-95ce-41b2-b279-cab1f2d1175c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e320fe64-93f4-4500-8e29-d108f2f221e3', 'serial': 'e320fe64-93f4-4500-8e29-d108f2f221e3'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'resources' on Instance uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'numa_topology' on Instance uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:21 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:27:21 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'vcpu_model' on Instance uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnBVzviS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:27:21 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:27:21 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:27:21 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[458113fc-7e1d-4f1b-9519-ad723d45be9c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RnBVzviS\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 08:27:21 user nova-compute[72998]: node.name = iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3
Aug 17 08:27:21 user nova-compute[72998]: node.tpgt = -1
Aug 17 08:27:21 user nova-compute[72998]: node.startup = automatic
Aug 17 08:27:21 user nova-compute[72998]: node.leading_login = No
Aug 17 08:27:21 user nova-compute[72998]: iface.iscsi_ifacename = default
Aug 17 08:27:21 user nova-compute[72998]: iface.net_ifacename = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.ipaddress = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.prefix_len = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.hwaddress = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.transport_name = tcp
Aug 17 08:27:21 user nova-compute[72998]: iface.initiatorname = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.state = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.vlan_id = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.vlan_priority = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.vlan_state = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.iface_num = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.mtu = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.port = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.bootproto = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.subnet_mask = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.gateway = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.dhcp_alt_client_id = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.dhcp_dns = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.dhcp_learn_iqn = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.dhcp_vendor_id_state = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.dhcp_vendor_id = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.dhcp_slp_da = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.fragmentation = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.gratuitous_arp = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.incoming_forwarding = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.tos_state = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.tos = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.ttl = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.delayed_ack = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.tcp_nagle = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.tcp_wsf_state = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.tcp_wsf = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.tcp_timer_scale = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.tcp_timestamp = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.redirect = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.def_task_mgmt_timeout = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.header_digest = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.data_digest = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.immediate_data = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.initial_r2t = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.data_seq_inorder = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.data_pdu_inorder = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.erl = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.max_receive_data_len = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.first_burst_len = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.max_outstanding_r2t = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.max_burst_len = 0
Aug 17 08:27:21 user nova-compute[72998]: iface.chap_auth = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.bidi_chap = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.strict_login_compliance = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.discovery_auth = <empty>
Aug 17 08:27:21 user nova-compute[72998]: iface.discovery_logout = <empty>
Aug 17 08:27:21 user nova-compute[72998]: node.discovery_address = <empty>
Aug 17 08:27:21 user nova-compute[72998]: node.discovery_port = 0
Aug 17 08:27:21 user nova-compute[72998]: node.discovery_type = static
Aug 17 08:27:21 user nova-compute[72998]: node.session.initial_cmdsn = 0
Aug 17 08:27:21 user nova-compute[72998]: node.session.initial_login_retry_max = 8
Aug 17 08:27:21 user nova-compute[72998]: node.session.xmit_thread_priority = -20
Aug 17 08:27:21 user nova-compute[72998]: node.session.cmds_max = 128
Aug 17 08:27:21 user nova-compute[72998]: node.session.queue_depth = 32
Aug 17 08:27:21 user nova-compute[72998]: node.session.nr_sessions = 1
Aug 17 08:27:21 user nova-compute[72998]: node.session.auth.authmethod = CHAP
Aug 17 08:27:21 user nova-compute[72998]: node.session.auth.username = RnBVzviS
Aug 17 08:27:21 user nova-compute[72998]: node.session.auth.password = ***
Aug 17 08:27:21 user nova-compute[72998]: node.session.auth.username_in = <empty>
Aug 17 08:27:21 user nova-compute[72998]: node.session.auth.password_in = <empty>
Aug 17 08:27:21 user nova-compute[72998]: node.session.auth.chap_algs = MD5
Aug 17 08:27:21 user nova-compute[72998]: node.session.timeo.replacement_timeout = 120
Aug 17 08:27:21 user nova-compute[72998]: node.session.err_timeo.abort_timeout = 15
Aug 17 08:27:21 user nova-compute[72998]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 08:27:21 user nova-compute[72998]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 08:27:21 user nova-compute[72998]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.FastAbort = Yes
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.InitialR2T = No
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.ImmediateData = Yes
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.MaxConnections = 1
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 08:27:21 user nova-compute[72998]: node.session.iscsi.ERL = 0
Aug 17 08:27:21 user nova-compute[72998]: node.session.scan = manual
Aug 17 08:27:21 user nova-compute[72998]: node.session.reopen_max = 0
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].address = 172.16.0.220
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].port = 3260
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].startup = manual
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].tcp.window_size = 524288
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].tcp.type_of_service = 0
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].timeo.logout_timeout = 15
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].timeo.login_timeout = 15
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].timeo.auth_timeout = 45
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].iscsi.DataDigest = None
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].iscsi.IFMarker = No
Aug 17 08:27:21 user nova-compute[72998]: node.conn[0].iscsi.OFMarker = No
Aug 17 08:27:21 user nova-compute[72998]: # END RECORD
Aug 17 08:27:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e4b1c2-e3ff-4f29-a747-c33948eb97e4]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b22688e-928b-414b-bcdf-9e35f29cad8a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnBVzviS {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnBVzviS" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[31015a0b-2857-4c45-90e2-6837ce953b97]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RnBVzviS'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f990c4b-f3b8-434d-b68d-fbf912c72fab]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9760cb-318a-4cd9-9e2a-4cf614d4a46a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:21 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:21 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:21 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:21 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:21 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:21 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] HCTL ('34', '0', '0', 0) found on session 25 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c884c6a-8520-4c8a-8bdc-e6c132835819]: (4, ('0 0 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching for a device in session 25 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnBVzviS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.177s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '26434346665353263', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434346665353263', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-531330378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-531330378',id=24,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-ymmjmalx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:25:49Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=d87b6f0b-95ce-41b2-b279-cab1f2d1175c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "vif_mac": "fa:16:3e:7c:6f:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "vif_mac": "fa:16:3e:7c:6f:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:6f:a1,bridge_name='br-int',has_traffic_filtering=True,id=bff9c917-7426-41b6-af07-b62567ce81df,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbff9c917-74') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'pci_devices' on Instance uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:27:21 user nova-compute[72998]:   <uuid>d87b6f0b-95ce-41b2-b279-cab1f2d1175c</uuid>
Aug 17 08:27:21 user nova-compute[72998]:   <name>instance-00000018</name>
Aug 17 08:27:21 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:27:21 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:27:21 user nova-compute[72998]:   <metadata>
Aug 17 08:27:21 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:27:21 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:27:21 user nova-compute[72998]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-531330378</nova:name>
Aug 17 08:27:21 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:27:21</nova:creationTime>
Aug 17 08:27:21 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:27:21 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:27:21 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:27:21 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:27:21 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:27:21 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:27:21 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:27:21 user nova-compute[72998]:       <nova:owner>
Aug 17 08:27:21 user nova-compute[72998]:         <nova:user uuid="cf94d9d63f9e4e5a9d0a4f175fddff16">tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member</nova:user>
Aug 17 08:27:21 user nova-compute[72998]:         <nova:project uuid="0ef0a0f5a7b6484483231263041317df">tempest-ServerBootFromVolumeStableRescueTest-1298365870</nova:project>
Aug 17 08:27:21 user nova-compute[72998]:       </nova:owner>
Aug 17 08:27:21 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:27:21 user nova-compute[72998]:       <nova:ports>
Aug 17 08:27:21 user nova-compute[72998]:         <nova:port uuid="bff9c917-7426-41b6-af07-b62567ce81df">
Aug 17 08:27:21 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 08:27:21 user nova-compute[72998]:         </nova:port>
Aug 17 08:27:21 user nova-compute[72998]:       </nova:ports>
Aug 17 08:27:21 user nova-compute[72998]:     </nova:instance>
Aug 17 08:27:21 user nova-compute[72998]:   </metadata>
Aug 17 08:27:21 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:27:21 user nova-compute[72998]:     <system>
Aug 17 08:27:21 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:27:21 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:27:21 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:27:21 user nova-compute[72998]:       <entry name="serial">d87b6f0b-95ce-41b2-b279-cab1f2d1175c</entry>
Aug 17 08:27:21 user nova-compute[72998]:       <entry name="uuid">d87b6f0b-95ce-41b2-b279-cab1f2d1175c</entry>
Aug 17 08:27:21 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:27:21 user nova-compute[72998]:     </system>
Aug 17 08:27:21 user nova-compute[72998]:   </sysinfo>
Aug 17 08:27:21 user nova-compute[72998]:   <os>
Aug 17 08:27:21 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:27:21 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:27:21 user nova-compute[72998]:   </os>
Aug 17 08:27:21 user nova-compute[72998]:   <features>
Aug 17 08:27:21 user nova-compute[72998]:     <acpi/>
Aug 17 08:27:21 user nova-compute[72998]:     <apic/>
Aug 17 08:27:21 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:27:21 user nova-compute[72998]:   </features>
Aug 17 08:27:21 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:27:21 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:27:21 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:27:21 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:27:21 user nova-compute[72998]:   </clock>
Aug 17 08:27:21 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:27:21 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:27:21 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:27:21 user nova-compute[72998]:   </cpu>
Aug 17 08:27:21 user nova-compute[72998]:   <devices>
Aug 17 08:27:21 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:27:21 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:27:21 user nova-compute[72998]:       <source dev="/dev/sdc"/>
Aug 17 08:27:21 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:27:21 user nova-compute[72998]:       <serial>e320fe64-93f4-4500-8e29-d108f2f221e3</serial>
Aug 17 08:27:21 user nova-compute[72998]:     </disk>
Aug 17 08:27:21 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:27:21 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:27:21 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.rescue"/>
Aug 17 08:27:21 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:27:21 user nova-compute[72998]:       <boot order="1"/>
Aug 17 08:27:21 user nova-compute[72998]:     </disk>
Aug 17 08:27:21 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:27:21 user nova-compute[72998]:       <mac address="fa:16:3e:7c:6f:a1"/>
Aug 17 08:27:21 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:27:21 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:27:21 user nova-compute[72998]:       <target dev="tapbff9c917-74"/>
Aug 17 08:27:21 user nova-compute[72998]:     </interface>
Aug 17 08:27:21 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:27:21 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/console.log" append="off"/>
Aug 17 08:27:21 user nova-compute[72998]:     </serial>
Aug 17 08:27:21 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:27:21 user nova-compute[72998]:     <video>
Aug 17 08:27:21 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:27:21 user nova-compute[72998]:     </video>
Aug 17 08:27:21 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:27:21 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:27:21 user nova-compute[72998]:     </rng>
Aug 17 08:27:21 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:27:21 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:27:21 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:27:21 user nova-compute[72998]:     </memballoon>
Aug 17 08:27:21 user nova-compute[72998]:   </devices>
Aug 17 08:27:21 user nova-compute[72998]: </domain>
Aug 17 08:27:21 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:27:21 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Instance destroyed successfully.
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:27:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No VIF found with MAC fa:16:3e:7c:6f:a1, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:27:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-63209cc7-26ee-4120-adfd-711249e9870f req-8a69b0fb-7d8d-41b5-98d8-87464a918819 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63209cc7-26ee-4120-adfd-711249e9870f req-8a69b0fb-7d8d-41b5-98d8-87464a918819 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63209cc7-26ee-4120-adfd-711249e9870f req-8a69b0fb-7d8d-41b5-98d8-87464a918819 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63209cc7-26ee-4120-adfd-711249e9870f req-8a69b0fb-7d8d-41b5-98d8-87464a918819 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-63209cc7-26ee-4120-adfd-711249e9870f req-8a69b0fb-7d8d-41b5-98d8-87464a918819 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:23 user nova-compute[72998]: WARNING nova.compute.manager [req-63209cc7-26ee-4120-adfd-711249e9870f req-8a69b0fb-7d8d-41b5-98d8-87464a918819 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state active and task_state rescuing.
Aug 17 08:27:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for d87b6f0b-95ce-41b2-b279-cab1f2d1175c due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:27:24 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260844.9939866, d87b6f0b-95ce-41b2-b279-cab1f2d1175c => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:27:24 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] VM Resumed (Lifecycle Event)
Aug 17 08:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-535b6a41-af72-4820-8c6f-70fe35028647 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:27:25 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 08:27:25 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260844.994966, d87b6f0b-95ce-41b2-b279-cab1f2d1175c => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:27:25 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] VM Started (Lifecycle Event)
Aug 17 08:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-7e19d08a-f151-4a96-85e9-35ca08c79322 req-161e3dd4-da30-400b-ba4c-5a7952a11091 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7e19d08a-f151-4a96-85e9-35ca08c79322 req-161e3dd4-da30-400b-ba4c-5a7952a11091 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7e19d08a-f151-4a96-85e9-35ca08c79322 req-161e3dd4-da30-400b-ba4c-5a7952a11091 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7e19d08a-f151-4a96-85e9-35ca08c79322 req-161e3dd4-da30-400b-ba4c-5a7952a11091 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-7e19d08a-f151-4a96-85e9-35ca08c79322 req-161e3dd4-da30-400b-ba4c-5a7952a11091 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:25 user nova-compute[72998]: WARNING nova.compute.manager [req-7e19d08a-f151-4a96-85e9-35ca08c79322 req-161e3dd4-da30-400b-ba4c-5a7952a11091 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state rescued and task_state None.
Aug 17 08:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:31 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260836.3614902, 8b55bd93-be1c-4b78-ab1a-adba05d5efde => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:27:31 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] VM Stopped (Lifecycle Event)
Aug 17 08:27:31 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6a5c6e4a-a637-43ec-a592-a58a3f24ac00 None None] [instance: 8b55bd93-be1c-4b78-ab1a-adba05d5efde] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:27:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:27:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:27:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:27:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:27:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:27:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:27:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-ec333507-ef02-4880-9281-c81879d93822 req-e62e7fb8-1256-4dd7-9874-798cdaf2a83d service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received event network-changed-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-ec333507-ef02-4880-9281-c81879d93822 req-e62e7fb8-1256-4dd7-9874-798cdaf2a83d service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Refreshing instance network info cache due to event network-changed-fcaef72a-ce0c-491a-a108-1b7a74c5c58e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:27:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ec333507-ef02-4880-9281-c81879d93822 req-e62e7fb8-1256-4dd7-9874-798cdaf2a83d service nova] Acquiring lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ec333507-ef02-4880-9281-c81879d93822 req-e62e7fb8-1256-4dd7-9874-798cdaf2a83d service nova] Acquired lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:38 user nova-compute[72998]: DEBUG nova.network.neutron [req-ec333507-ef02-4880-9281-c81879d93822 req-e62e7fb8-1256-4dd7-9874-798cdaf2a83d service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Refreshing network info cache for port fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:27:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-ec333507-ef02-4880-9281-c81879d93822 req-e62e7fb8-1256-4dd7-9874-798cdaf2a83d service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updated VIF entry in instance network info cache for port fcaef72a-ce0c-491a-a108-1b7a74c5c58e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:27:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-ec333507-ef02-4880-9281-c81879d93822 req-e62e7fb8-1256-4dd7-9874-798cdaf2a83d service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updating instance_info_cache with network_info: [{"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ec333507-ef02-4880-9281-c81879d93822 req-e62e7fb8-1256-4dd7-9874-798cdaf2a83d service nova] Releasing lock "refresh_cache-e2b811f8-19a3-4b50-8ea9-6d3442c38819" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Stashing vm_state: active {{(pid=72998) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 08:27:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'pci_requests' on Instance uuid 603c6577-f34a-450d-a137-603469e19ede {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:39 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:27:39 user nova-compute[72998]: INFO nova.compute.claims [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Claim successful on node user
Aug 17 08:27:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'resources' on Instance uuid 603c6577-f34a-450d-a137-603469e19ede {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'pci_devices' on Instance uuid 603c6577-f34a-450d-a137-603469e19ede {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:39 user nova-compute[72998]: INFO nova.compute.resource_tracker [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating resource usage from migration 89146928-ec99-45fb-b1cd-78994e0047bc
Aug 17 08:27:40 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.440s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:40 user nova-compute[72998]: INFO nova.compute.manager [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Migrating
Aug 17 08:27:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:40 user nova-compute[72998]: INFO nova.compute.rpcapi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 17 08:27:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquired lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-74256a4b-1e63-4881-9471-c7a58804e901 req-f60fcff8-04a4-4913-9a26-fcb2c1bef646 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-changed-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-74256a4b-1e63-4881-9471-c7a58804e901 req-f60fcff8-04a4-4913-9a26-fcb2c1bef646 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Refreshing instance network info cache due to event network-changed-726f4b3e-5fa4-4747-8f97-a1c7853bf57e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-74256a4b-1e63-4881-9471-c7a58804e901 req-f60fcff8-04a4-4913-9a26-fcb2c1bef646 service nova] Acquiring lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating instance_info_cache with network_info: [{"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Releasing lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-74256a4b-1e63-4881-9471-c7a58804e901 req-f60fcff8-04a4-4913-9a26-fcb2c1bef646 service nova] Acquired lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:40 user nova-compute[72998]: DEBUG nova.network.neutron [req-74256a4b-1e63-4881-9471-c7a58804e901 req-f60fcff8-04a4-4913-9a26-fcb2c1bef646 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Refreshing network info cache for port 726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Starting migrate_disk_and_power_off {{(pid=72998) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG nova.network.neutron [req-74256a4b-1e63-4881-9471-c7a58804e901 req-f60fcff8-04a4-4913-9a26-fcb2c1bef646 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updated VIF entry in instance network info cache for port 726f4b3e-5fa4-4747-8f97-a1c7853bf57e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG nova.network.neutron [req-74256a4b-1e63-4881-9471-c7a58804e901 req-f60fcff8-04a4-4913-9a26-fcb2c1bef646 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating instance_info_cache with network_info: [{"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-74256a4b-1e63-4881-9471-c7a58804e901 req-f60fcff8-04a4-4913-9a26-fcb2c1bef646 service nova] Releasing lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:41 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] Instance destroyed successfully.
Aug 17 08:27:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405697983',display_name='tempest-ServerActionsTestOtherA-server-1405697983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405697983',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwso8zXzyr8rdW+F3TIWTcGQW2195HR8rtDbyl+3RZbz4rT8sA0T1Nq594b2NMeWJ/ZCBUqUIDbRSEtao2k3JmymnhZIpHBjG50mdl6hk0l6mAeujcqHjcduFAXBAHWg==',key_name='tempest-keypair-622925506',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:26:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-ss81oka0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=603c6577-f34a-450d-a137-603469e19ede,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-365291349-network", "vif_mac": "fa:16:3e:24:5f:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-365291349-network", "vif_mac": "fa:16:3e:24:5f:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG os_vif [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap726f4b3e-5f, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:27:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:41 user nova-compute[72998]: INFO os_vif [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f')
Aug 17 08:27:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvkbCdPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:27:42 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e99655-dcea-481d-b3a8-fc6a173ce903]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a673a6-4a64-4f6a-8943-64398edac9ce]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:42 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:42 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:42 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:42 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:42 user nova-compute[72998]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:42 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464bfc310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5'): ({'sdd'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Removing single pathed devices sdd {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[db966e1c-9c65-4f50-b237-55e7a8143e3f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[46348c60-ee59-41d7-a306-28a677293f29]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flushing IO for device /dev/sdd {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c153258-7553-4e5c-820b-90bed8afd7e5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[43051d73-c664-40b2-8cc1-15602b224171]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23530383837626165', '/dev/disk/by-id/scsi-1SCST_BIOa4eacf53-50887baec743d0ec', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a4eacf53') {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2deed4b-0760-4cc3-b0eb-4439f0755660]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67754a8-ce76-486a-b11c-fb819b085c8c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3683ecc5-9a4c-45ea-a1de-84501b935079]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260]
Aug 17 08:27:42 user nova-compute[72998]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260] successful.
Aug 17 08:27:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[516405b1-1cc0-467b-8a37-403f119732d7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== disconnect_volume: return (313ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-unplugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] No waiting events found dispatching network-vif-unplugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:42 user nova-compute[72998]: WARNING nova.compute.manager [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received unexpected event network-vif-unplugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e for instance with vm_state active and task_state resize_migrating.
Aug 17 08:27:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] No waiting events found dispatching network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:42 user nova-compute[72998]: WARNING nova.compute.manager [req-73b16273-e97e-4875-aec5-c082fd071106 req-5e20dd53-6774-493b-a256-656b8ffb92ab service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received unexpected event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e for instance with vm_state active and task_state resize_migrating.
Aug 17 08:27:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-42c1f272-3c47-496d-9894-c2f817c0fc5e req-0f9029cc-ed56-4642-875b-04725ecfca62 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-changed-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-42c1f272-3c47-496d-9894-c2f817c0fc5e req-0f9029cc-ed56-4642-875b-04725ecfca62 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Refreshing instance network info cache due to event network-changed-5160fa81-e465-4cf0-b0a0-862256c60f8b. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-42c1f272-3c47-496d-9894-c2f817c0fc5e req-0f9029cc-ed56-4642-875b-04725ecfca62 service nova] Acquiring lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-42c1f272-3c47-496d-9894-c2f817c0fc5e req-0f9029cc-ed56-4642-875b-04725ecfca62 service nova] Acquired lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-42c1f272-3c47-496d-9894-c2f817c0fc5e req-0f9029cc-ed56-4642-875b-04725ecfca62 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Refreshing network info cache for port 5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG nova.network.neutron [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Port 726f4b3e-5fa4-4747-8f97-a1c7853bf57e binding to destination host user is already ACTIVE {{(pid=72998) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquired lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG nova.network.neutron [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-42c1f272-3c47-496d-9894-c2f817c0fc5e req-0f9029cc-ed56-4642-875b-04725ecfca62 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updated VIF entry in instance network info cache for port 5160fa81-e465-4cf0-b0a0-862256c60f8b. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-42c1f272-3c47-496d-9894-c2f817c0fc5e req-0f9029cc-ed56-4642-875b-04725ecfca62 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updating instance_info_cache with network_info: [{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-42c1f272-3c47-496d-9894-c2f817c0fc5e req-0f9029cc-ed56-4642-875b-04725ecfca62 service nova] Releasing lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG nova.network.neutron [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating instance_info_cache with network_info: [{"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Releasing lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG os_brick.utils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef6225a-7198-47e6-aa32-a21348648109]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[113ba0bb-d698-4927-88c8-28ec2c69eb9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6fe16c-0eff-4ca9-84b8-24fa59b07ab0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fef0b7-181c-46f4-847c-d2b61cf2b08d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:27:44 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:27:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a152fae4-5c43-46d9-917c-a784f7b4e74f]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:27:44 user nova-compute[72998]: DEBUG os_brick.utils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:27:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:47 user nova-compute[72998]: INFO nova.compute.manager [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Shelving
Aug 17 08:27:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-ae7551da-e424-4622-a47b-3dedcbb98daf req-54bfea8c-f175-4983-bed9-733bd2f40cc4 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-unplugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ae7551da-e424-4622-a47b-3dedcbb98daf req-54bfea8c-f175-4983-bed9-733bd2f40cc4 service nova] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ae7551da-e424-4622-a47b-3dedcbb98daf req-54bfea8c-f175-4983-bed9-733bd2f40cc4 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ae7551da-e424-4622-a47b-3dedcbb98daf req-54bfea8c-f175-4983-bed9-733bd2f40cc4 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-ae7551da-e424-4622-a47b-3dedcbb98daf req-54bfea8c-f175-4983-bed9-733bd2f40cc4 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] No waiting events found dispatching network-vif-unplugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:48 user nova-compute[72998]: WARNING nova.compute.manager [req-ae7551da-e424-4622-a47b-3dedcbb98daf req-54bfea8c-f175-4983-bed9-733bd2f40cc4 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received unexpected event network-vif-unplugged-5160fa81-e465-4cf0-b0a0-862256c60f8b for instance with vm_state active and task_state shelving.
Aug 17 08:27:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance destroyed successfully.
Aug 17 08:27:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Beginning cold snapshot process
Aug 17 08:27:49 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:27:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk /opt/stack/data/nova/instances/snapshots/tmp82g1ay7i/92e3585e45fb40e7954dbe4317290480 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk /opt/stack/data/nova/instances/snapshots/tmp82g1ay7i/92e3585e45fb40e7954dbe4317290480" returned: 0 in 0.432s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Snapshot extracted, beginning image upload
Aug 17 08:27:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-4813a588-6ae1-478f-be70-4a53afb4141e req-134fd134-68eb-45f8-a7c3-2433edad0d6e service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4813a588-6ae1-478f-be70-4a53afb4141e req-134fd134-68eb-45f8-a7c3-2433edad0d6e service nova] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4813a588-6ae1-478f-be70-4a53afb4141e req-134fd134-68eb-45f8-a7c3-2433edad0d6e service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4813a588-6ae1-478f-be70-4a53afb4141e req-134fd134-68eb-45f8-a7c3-2433edad0d6e service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-4813a588-6ae1-478f-be70-4a53afb4141e req-134fd134-68eb-45f8-a7c3-2433edad0d6e service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] No waiting events found dispatching network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:50 user nova-compute[72998]: WARNING nova.compute.manager [req-4813a588-6ae1-478f-be70-4a53afb4141e req-134fd134-68eb-45f8-a7c3-2433edad0d6e service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received unexpected event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 08:27:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG nova.objects.instance [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'flavor' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:51 user nova-compute[72998]: INFO nova.compute.manager [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Attaching volume 3c6d5e7f-f3b0-4c02-983b-4594be7d8551 to /dev/vdb
Aug 17 08:27:51 user nova-compute[72998]: DEBUG os_brick.utils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72d1c5f-7c71-4de4-9688-65b397fe2ac3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[752e68c4-efd9-4536-82a1-1b0a224f04d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc7b10-23bd-4f59-9820-a13f767c559a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c5cc71-fa8e-4af5-bf21-7972ca23e1f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:27:51 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:27:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4aa7ad-2a95-4b65-b38f-981029e8940a]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG os_brick.utils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating existing volume attachment record: ea6386bc-224d-4ea0-bb8b-1213ed340d2d {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:27:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Snapshot image upload complete
Aug 17 08:27:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:27:52 user nova-compute[72998]: INFO nova.compute.manager [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Shelve offloading
Aug 17 08:27:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance destroyed successfully.
Aug 17 08:27:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:27:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquired lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:27:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updating instance_info_cache with network_info: [{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Releasing lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance destroyed successfully.
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'resources' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2116780994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2116780994',id=26,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBTxnYxvo0uWtR5DDPn4Y7ih+7xoHXCALaDB711cb16A/xwqCq8+SdyaE419S/Pag051ZYUroUtYYfDERIa7JrJbquhP62+TE9hkelD8yUpjZ2kPnUfiyH8ECV7KdfEzw==',key_name='tempest-keypair-1914279933',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:25:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-zjvfbzbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member',shelved_at='2023-08-17T08:27:52.286962',shelved_host='user',shelved_image_id='813a2588-16f4-4269-b238-82a0cfe124d9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=382786b5-2479-4260-8be7-e56513d85fb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG os_vif [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5160fa81-e4, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-c7ea0b78-f05f-4dbe-84eb-7acc5e78711b req-09528388-a4da-470f-a938-75fdf2c45c1a service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-changed-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-c7ea0b78-f05f-4dbe-84eb-7acc5e78711b req-09528388-a4da-470f-a938-75fdf2c45c1a service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Refreshing instance network info cache due to event network-changed-5160fa81-e465-4cf0-b0a0-862256c60f8b. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c7ea0b78-f05f-4dbe-84eb-7acc5e78711b req-09528388-a4da-470f-a938-75fdf2c45c1a service nova] Acquiring lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c7ea0b78-f05f-4dbe-84eb-7acc5e78711b req-09528388-a4da-470f-a938-75fdf2c45c1a service nova] Acquired lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.network.neutron [req-c7ea0b78-f05f-4dbe-84eb-7acc5e78711b req-09528388-a4da-470f-a938-75fdf2c45c1a service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Refreshing network info cache for port 5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:53 user nova-compute[72998]: INFO os_vif [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4')
Aug 17 08:27:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Deleting instance files /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3_del
Aug 17 08:27:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Deletion of /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3_del complete
Aug 17 08:27:53 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Deleted allocations for instance 382786b5-2479-4260-8be7-e56513d85fb3
Aug 17 08:27:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'numa_topology' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.network.neutron [req-c7ea0b78-f05f-4dbe-84eb-7acc5e78711b req-09528388-a4da-470f-a938-75fdf2c45c1a service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updated VIF entry in instance network info cache for port 5160fa81-e465-4cf0-b0a0-862256c60f8b. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.network.neutron [req-c7ea0b78-f05f-4dbe-84eb-7acc5e78711b req-09528388-a4da-470f-a938-75fdf2c45c1a service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updating instance_info_cache with network_info: [{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5160fa81-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c7ea0b78-f05f-4dbe-84eb-7acc5e78711b req-09528388-a4da-470f-a938-75fdf2c45c1a service nova] Releasing lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:27:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-26b4f796-cf25-494a-9196-d6743cf0c760 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.044s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Starting finish_migration {{(pid=72998) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Instance directory exists: not creating {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 08:27:55 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Creating image(s)
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Ensure instance console log exists: /opt/stack/data/nova/instances/603c6577-f34a-450d-a137-603469e19ede/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Start _get_guest_xml network_info=[{"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-365291349-network", "vif_mac": "fa:16:3e:24:5f:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7f5c0ec0-1a54-420c-adbf-acc5b7098748', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvkbCdPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '603c6577-f34a-450d-a137-603469e19ede', 'attached_at': '2023-08-17T08:27:55.000000', 'detached_at': '', 'volume_id': '9fb70aa3-b710-4008-951d-e0e5efb221b5', 'serial': '9fb70aa3-b710-4008-951d-e0e5efb221b5'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:27:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:27:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'vcpu_model' on Instance uuid 603c6577-f34a-450d-a137-603469e19ede {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvkbCdPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:27:55 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:27:55 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:27:55 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffbad85-ebe0-4d7c-9384-83bc1c7b58c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:27:55 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[719d9a56-a209-4e21-8274-1d48351d5f66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5] added
Aug 17 08:27:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.123s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff961fbc-71fd-4941-aadb-061c10434a69]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.110s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62f2fea-5848-4413-accf-5daccfddd570]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nvkbCdPJ {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nvkbCdPJ" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e4e068-ff18-4896-ab07-97b70580b30e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nvkbCdPJ'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb025f7-f26f-4758-8c2e-969cacb6b70a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebd20dd-fe19-4eba-a605-0ebd7984a85a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a567756-7f7a-40b0-9973-5abd1d153aae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260]
Aug 17 08:27:55 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260] successful.
Aug 17 08:27:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d6d5b-24c9-4e7c-857f-308a46f794ec]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd52f54-dfd9-4777-ab93-2537265387b9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:27:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[522f79bc-aa59-4b6b-b3b1-bf61ba27d22f]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:27:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvkbCdPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '23530383837626165', 'path': '/dev/sdd'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530383837626165', 'path': '/dev/sdd'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405697983',display_name='tempest-ServerActionsTestOtherA-server-1405697983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405697983',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwso8zXzyr8rdW+F3TIWTcGQW2195HR8rtDbyl+3RZbz4rT8sA0T1Nq594b2NMeWJ/ZCBUqUIDbRSEtao2k3JmymnhZIpHBjG50mdl6hk0l6mAeujcqHjcduFAXBAHWg==',key_name='tempest-keypair-622925506',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:26:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-ss81oka0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=603c6577-f34a-450d-a137-603469e19ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-365291349-network", "vif_mac": "fa:16:3e:24:5f:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-365291349-network", "vif_mac": "fa:16:3e:24:5f:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:27:56 user nova-compute[72998]:   <uuid>603c6577-f34a-450d-a137-603469e19ede</uuid>
Aug 17 08:27:56 user nova-compute[72998]:   <name>instance-00000019</name>
Aug 17 08:27:56 user nova-compute[72998]:   <memory>2097152</memory>
Aug 17 08:27:56 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:27:56 user nova-compute[72998]:   <metadata>
Aug 17 08:27:56 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:27:56 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:27:56 user nova-compute[72998]:       <nova:name>tempest-ServerActionsTestOtherA-server-1405697983</nova:name>
Aug 17 08:27:56 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:27:55</nova:creationTime>
Aug 17 08:27:56 user nova-compute[72998]:       <nova:flavor name="m1.small">
Aug 17 08:27:56 user nova-compute[72998]:         <nova:memory>2048</nova:memory>
Aug 17 08:27:56 user nova-compute[72998]:         <nova:disk>20</nova:disk>
Aug 17 08:27:56 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:27:56 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:27:56 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:27:56 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:27:56 user nova-compute[72998]:       <nova:owner>
Aug 17 08:27:56 user nova-compute[72998]:         <nova:user uuid="0be579ee85cb4ac2b59812bbee48c272">tempest-ServerActionsTestOtherA-1892042619-project-member</nova:user>
Aug 17 08:27:56 user nova-compute[72998]:         <nova:project uuid="d62167eb6909402f8dca89678acff055">tempest-ServerActionsTestOtherA-1892042619</nova:project>
Aug 17 08:27:56 user nova-compute[72998]:       </nova:owner>
Aug 17 08:27:56 user nova-compute[72998]:       <nova:ports>
Aug 17 08:27:56 user nova-compute[72998]:         <nova:port uuid="726f4b3e-5fa4-4747-8f97-a1c7853bf57e">
Aug 17 08:27:56 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 08:27:56 user nova-compute[72998]:         </nova:port>
Aug 17 08:27:56 user nova-compute[72998]:       </nova:ports>
Aug 17 08:27:56 user nova-compute[72998]:     </nova:instance>
Aug 17 08:27:56 user nova-compute[72998]:   </metadata>
Aug 17 08:27:56 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:27:56 user nova-compute[72998]:     <system>
Aug 17 08:27:56 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:27:56 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:27:56 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:27:56 user nova-compute[72998]:       <entry name="serial">603c6577-f34a-450d-a137-603469e19ede</entry>
Aug 17 08:27:56 user nova-compute[72998]:       <entry name="uuid">603c6577-f34a-450d-a137-603469e19ede</entry>
Aug 17 08:27:56 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:27:56 user nova-compute[72998]:     </system>
Aug 17 08:27:56 user nova-compute[72998]:   </sysinfo>
Aug 17 08:27:56 user nova-compute[72998]:   <os>
Aug 17 08:27:56 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:27:56 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:27:56 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:27:56 user nova-compute[72998]:   </os>
Aug 17 08:27:56 user nova-compute[72998]:   <features>
Aug 17 08:27:56 user nova-compute[72998]:     <acpi/>
Aug 17 08:27:56 user nova-compute[72998]:     <apic/>
Aug 17 08:27:56 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:27:56 user nova-compute[72998]:   </features>
Aug 17 08:27:56 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:27:56 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:27:56 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:27:56 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:27:56 user nova-compute[72998]:   </clock>
Aug 17 08:27:56 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:27:56 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:27:56 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:27:56 user nova-compute[72998]:   </cpu>
Aug 17 08:27:56 user nova-compute[72998]:   <devices>
Aug 17 08:27:56 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:27:56 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:27:56 user nova-compute[72998]:       <source dev="/dev/sdd"/>
Aug 17 08:27:56 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:27:56 user nova-compute[72998]:       <serial>9fb70aa3-b710-4008-951d-e0e5efb221b5</serial>
Aug 17 08:27:56 user nova-compute[72998]:     </disk>
Aug 17 08:27:56 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:27:56 user nova-compute[72998]:       <mac address="fa:16:3e:24:5f:81"/>
Aug 17 08:27:56 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:27:56 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:27:56 user nova-compute[72998]:       <target dev="tap726f4b3e-5f"/>
Aug 17 08:27:56 user nova-compute[72998]:     </interface>
Aug 17 08:27:56 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:27:56 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/603c6577-f34a-450d-a137-603469e19ede/console.log" append="off"/>
Aug 17 08:27:56 user nova-compute[72998]:     </serial>
Aug 17 08:27:56 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:27:56 user nova-compute[72998]:     <video>
Aug 17 08:27:56 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:27:56 user nova-compute[72998]:     </video>
Aug 17 08:27:56 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:27:56 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:27:56 user nova-compute[72998]:     </rng>
Aug 17 08:27:56 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:27:56 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:27:56 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:27:56 user nova-compute[72998]:     </memballoon>
Aug 17 08:27:56 user nova-compute[72998]:   </devices>
Aug 17 08:27:56 user nova-compute[72998]: </domain>
Aug 17 08:27:56 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405697983',display_name='tempest-ServerActionsTestOtherA-server-1405697983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405697983',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwso8zXzyr8rdW+F3TIWTcGQW2195HR8rtDbyl+3RZbz4rT8sA0T1Nq594b2NMeWJ/ZCBUqUIDbRSEtao2k3JmymnhZIpHBjG50mdl6hk0l6mAeujcqHjcduFAXBAHWg==',key_name='tempest-keypair-622925506',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:26:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-ss81oka0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=603c6577-f34a-450d-a137-603469e19ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-365291349-network", "vif_mac": "fa:16:3e:24:5f:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-365291349-network", "vif_mac": "fa:16:3e:24:5f:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG os_vif [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260861.962556, 603c6577-f34a-450d-a137-603469e19ede => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:27:56 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] VM Stopped (Lifecycle Event)
Aug 17 08:27:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap726f4b3e-5f, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap726f4b3e-5f, col_values=(('external_ids', {'iface-id': '726f4b3e-5fa4-4747-8f97-a1c7853bf57e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:5f:81', 'vm-uuid': '603c6577-f34a-450d-a137-603469e19ede'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d442b104-f3fe-47c4-8a7c-2a3fbebc38ec None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d442b104-f3fe-47c4-8a7c-2a3fbebc38ec None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:27:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:56 user nova-compute[72998]: INFO os_vif [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f')
Aug 17 08:27:57 user nova-compute[72998]: INFO nova.compute.manager [None req-d442b104-f3fe-47c4-8a7c-2a3fbebc38ec None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 08:27:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:27:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] No VIF found with MAC fa:16:3e:24:5f:81, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-128d9894-147c-495a-b57f-a4f0cadfa588 req-daa9dc39-664e-4b40-9c0d-6180d9f01c6e service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-128d9894-147c-495a-b57f-a4f0cadfa588 req-daa9dc39-664e-4b40-9c0d-6180d9f01c6e service nova] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-128d9894-147c-495a-b57f-a4f0cadfa588 req-daa9dc39-664e-4b40-9c0d-6180d9f01c6e service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-128d9894-147c-495a-b57f-a4f0cadfa588 req-daa9dc39-664e-4b40-9c0d-6180d9f01c6e service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:27:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-128d9894-147c-495a-b57f-a4f0cadfa588 req-daa9dc39-664e-4b40-9c0d-6180d9f01c6e service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] No waiting events found dispatching network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:27:58 user nova-compute[72998]: WARNING nova.compute.manager [req-128d9894-147c-495a-b57f-a4f0cadfa588 req-daa9dc39-664e-4b40-9c0d-6180d9f01c6e service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received unexpected event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e for instance with vm_state active and task_state resize_finish.
Aug 17 08:27:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260880.3918264, 603c6577-f34a-450d-a137-603469e19ede => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] VM Resumed (Lifecycle Event)
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:28:00 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] Instance running successfully.
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Failed to set time: agent not configured {{(pid=72998) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66280b5c-30b7-43e7-89a7-af39d362b458 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] finish_migration finished successfully. {{(pid=72998) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:28:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260880.394868, 603c6577-f34a-450d-a137-603469e19ede => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] VM Started (Lifecycle Event)
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:28:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-8eb53637-224b-4462-86d1-692475751339 req-08e83c35-c032-471e-bd34-b292139b192d service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8eb53637-224b-4462-86d1-692475751339 req-08e83c35-c032-471e-bd34-b292139b192d service nova] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8eb53637-224b-4462-86d1-692475751339 req-08e83c35-c032-471e-bd34-b292139b192d service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8eb53637-224b-4462-86d1-692475751339 req-08e83c35-c032-471e-bd34-b292139b192d service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-8eb53637-224b-4462-86d1-692475751339 req-08e83c35-c032-471e-bd34-b292139b192d service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] No waiting events found dispatching network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:00 user nova-compute[72998]: WARNING nova.compute.manager [req-8eb53637-224b-4462-86d1-692475751339 req-08e83c35-c032-471e-bd34-b292139b192d service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received unexpected event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e for instance with vm_state active and task_state resize_finish.
Aug 17 08:28:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:28:02 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:28:02 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:28:02 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9838f-78cc-4bed-9338-f5d492f9090c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:28:02 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[051b8eba-b7ca-4765-8ef1-0e3cf7a355b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551] added
Aug 17 08:28:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18566d-53e7-4779-92f8-1f5a2e375343]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[83211379-fe8a-4233-bd91-d4da85d1bfe2]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCyoBIwl {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCyoBIwl" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[317fca14-aa39-43f8-9ec8-b0c0dae4023f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JCyoBIwl'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ee022b-eeb3-4839-9c17-e502110877b4]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d9661d-12c9-4c04-aa61-300918ce4d3a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea485878-2111-42b5-8663-828bd5f7476c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]
Aug 17 08:28:02 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.
Aug 17 08:28:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f176453-8b47-4284-8013-5905b110d9b7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed80eb9-6485-4e65-8305-69e032a21ae7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:28:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06f50cd-99a5-4502-930b-ed2156425635]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:28:03 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260868.756698, 382786b5-2479-4260-8be7-e56513d85fb3 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:03 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] VM Stopped (Lifecycle Event)
Aug 17 08:28:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1b280eaa-1eac-4ec5-93c9-50b4b4acc478 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:03 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:28:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:28:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:28:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26333346466303963', 'path': '/dev/sde'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:28:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333346466303963', 'path': '/dev/sde'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:28:03 user nova-compute[72998]: DEBUG nova.objects.instance [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'flavor' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:28:03 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:28:03 user nova-compute[72998]:   <source dev="/dev/sde"/>
Aug 17 08:28:03 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:28:03 user nova-compute[72998]:   <serial>3c6d5e7f-f3b0-4c02-983b-4594be7d8551</serial>
Aug 17 08:28:03 user nova-compute[72998]: </disk>
Aug 17 08:28:03 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:28:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:28:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:28:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] No VIF found with MAC fa:16:3e:36:9d:90, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:28:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-785d2ce1-a89a-468c-ab28-d1c8fcb1b5ff tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.159s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:28:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:28:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:28:04 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:28:05 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updating instance_info_cache with network_info: [{"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-7b895ebd-5c4d-4350-9cbc-39e427e0cb05" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:28:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:28:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Stashing vm_state: active {{(pid=72998) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 08:28:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:28:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:28:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:28:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:28:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:07 user nova-compute[72998]: DEBUG nova.objects.instance [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'pci_requests' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:07 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:28:07 user nova-compute[72998]: INFO nova.compute.claims [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Claim successful on node user
Aug 17 08:28:07 user nova-compute[72998]: DEBUG nova.objects.instance [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'resources' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:07 user nova-compute[72998]: DEBUG nova.objects.instance [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'pci_devices' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:07 user nova-compute[72998]: INFO nova.compute.resource_tracker [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating resource usage from migration f644891c-580d-4d34-a732-356f754a6ab5
Aug 17 08:28:07 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:28:07 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:28:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.540s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:07 user nova-compute[72998]: INFO nova.compute.manager [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Migrating
Aug 17 08:28:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:28:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquired lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:28:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Releasing lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Starting migrate_disk_and_power_off {{(pid=72998) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-831d55a0-b14e-4912-976e-c6b77e64ca5c req-fec2bfb6-eecb-467a-aaf1-940144367288 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-831d55a0-b14e-4912-976e-c6b77e64ca5c req-fec2bfb6-eecb-467a-aaf1-940144367288 service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-831d55a0-b14e-4912-976e-c6b77e64ca5c req-fec2bfb6-eecb-467a-aaf1-940144367288 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-831d55a0-b14e-4912-976e-c6b77e64ca5c req-fec2bfb6-eecb-467a-aaf1-940144367288 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-831d55a0-b14e-4912-976e-c6b77e64ca5c req-fec2bfb6-eecb-467a-aaf1-940144367288 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:08 user nova-compute[72998]: WARNING nova.compute.manager [req-831d55a0-b14e-4912-976e-c6b77e64ca5c req-fec2bfb6-eecb-467a-aaf1-940144367288 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state resize_migrating.
Aug 17 08:28:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:28:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance destroyed successfully.
Aug 17 08:28:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1893379751',display_name='tempest-ServerActionsTestOtherB-server-1893379751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1893379751',id=21,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1sywPS7noB6enRkafRCV4V8gUajrQp1IvyFeTNyX5oNNHzp72oZWl7JWE9EVMF5YzyYJVOw45540lSzJ/aE8AmU535jNS6dcszNW9Kp6/r+UbKETYBcWkdMqhnsqo26g==',key_name='tempest-keypair-2137913041',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='90f94111e9fa4659a975f8478d7ca7da',ramdisk_id='',reservation_id='r-t6pdxe0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1997511094',owner_user_name='tempest-ServerActionsTestOtherB-1997511094-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cbf4e4b883f484980af4bde95f8fd88',uuid=4119f28a-b9f1-4996-a144-68edd4f08c44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1268549478-network", "vif_mac": "fa:16:3e:36:9d:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converting VIF {"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1268549478-network", "vif_mac": "fa:16:3e:36:9d:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_vif [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9cd3f5a-80, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:09 user nova-compute[72998]: INFO os_vif [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80')
Aug 17 08:28:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:28:09 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e5315c-d047-437d-ac31-4c57d26484ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab1642a-69c1-4288-9193-8279157c90df]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:09 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:09 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:09 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:09 user nova-compute[72998]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:28:09 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:09 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:09 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:09 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:09 user nova-compute[72998]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:28:09 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4886dba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'): ({'sde'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Removing single pathed devices sde {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c613246-4b20-45c1-918a-d91041b78b9d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e59d888-4642-4c99-9984-528c7c724d23]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Flushing IO for device /dev/sde {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2326abdb-a967-4b38-8bd9-68cf4900f8ac]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef1c5a9-b7f0-4ba3-a02d-aaac66c70b75]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f2c4d8-8779-4df9-ae3d-bb66f5bebfad]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b1417-423f-4951-b135-e0e0e4c1f71a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]
Aug 17 08:28:09 user nova-compute[72998]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.
Aug 17 08:28:09 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb0a351-a95e-4bba-86ad-4725f7d058ee]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] <== disconnect_volume: return (357ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:28:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44_resize/disk /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "cp -r /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44_resize/disk /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk" returned: 0 in 0.379s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44_resize/disk.info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk.info {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "cp -r /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44_resize/disk.info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk.info" returned: 0 in 0.032s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-71a16b75-d1c0-4d9c-8e84-70b1f27bd1ec req-c6037ae2-d093-41c6-afc5-afd8a48d1d9c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71a16b75-d1c0-4d9c-8e84-70b1f27bd1ec req-c6037ae2-d093-41c6-afc5-afd8a48d1d9c service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71a16b75-d1c0-4d9c-8e84-70b1f27bd1ec req-c6037ae2-d093-41c6-afc5-afd8a48d1d9c service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71a16b75-d1c0-4d9c-8e84-70b1f27bd1ec req-c6037ae2-d093-41c6-afc5-afd8a48d1d9c service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-71a16b75-d1c0-4d9c-8e84-70b1f27bd1ec req-c6037ae2-d093-41c6-afc5-afd8a48d1d9c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:10 user nova-compute[72998]: WARNING nova.compute.manager [req-71a16b75-d1c0-4d9c-8e84-70b1f27bd1ec req-c6037ae2-d093-41c6-afc5-afd8a48d1d9c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state resize_migrating.
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:28:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG nova.network.neutron [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Port e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 binding to destination host user is already ACTIVE {{(pid=72998) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquired lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG nova.network.neutron [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG nova.network.neutron [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Releasing lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG os_brick.utils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05e676e-68b8-4fc6-8bf9-da5a361418ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[467009ab-b1fd-48b3-bc4e-967e5ac8f30c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd797469-5d9d-4a32-9b4a-792481b088c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3fae4f-ed89-4ca1-8e5e-aab2a66c391a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:28:13 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed3b419-d227-45a9-85d9-ca097a2f5517]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG os_brick.utils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:28:13 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:28:13 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7671MB free_disk=24.06529998779297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Applying migration context for instance 603c6577-f34a-450d-a137-603469e19ede as it has an incoming, in-progress migration 89146928-ec99-45fb-b1cd-78994e0047bc. Migration status is finished {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Applying migration context for instance 4119f28a-b9f1-4996-a144-68edd4f08c44 as it has an incoming, in-progress migration f644891c-580d-4d34-a732-356f754a6ab5. Migration status is post-migrating {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 08:28:13 user nova-compute[72998]: INFO nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating resource usage from migration 89146928-ec99-45fb-b1cd-78994e0047bc
Aug 17 08:28:13 user nova-compute[72998]: INFO nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating resource usage from migration f644891c-580d-4d34-a732-356f754a6ab5
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8067a647-dca0-47d4-a472-eac43a2e4de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Migration 89146928-ec99-45fb-b1cd-78994e0047bc is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 603c6577-f34a-450d-a137-603469e19ede actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Migration f644891c-580d-4d34-a732-356f754a6ab5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:28:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:28:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:14 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:28:14 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:28:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:28:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:28:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:20 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:28:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquired lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:28:20 user nova-compute[72998]: DEBUG nova.network.neutron [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:28:20 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'info_cache' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:20 user nova-compute[72998]: DEBUG nova.network.neutron [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updating instance_info_cache with network_info: [{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Releasing lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:28:21 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance destroyed successfully.
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'resources' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1003522619',display_name='tempest-AttachVolumeTestJSON-server-1003522619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1003522619',id=22,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmc8qbkgbu95dJvwY1bo5kn9RJpsYoyrns3+CWvhffMSTP6KyY1SbvmOYfexUjDzD3737D3c8fhHlVWQh2nyWElT5uU1HwkwSVrOW/xi1hx6Ymm9am4ZS8Qy8EFRomqnw==',key_name='tempest-keypair-346425477',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-h31cebic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=87850ffb-dfa9-4b23-bd18-938744cd9b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_vif [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85901016-fa, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:28:21 user nova-compute[72998]: INFO os_vif [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa')
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnTEULqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:28:21 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc25cc0b-f48b-4edc-a852-507029a24008]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[28109bef-fc22-4329-aa44-6538bba1cc4e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464dbc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986'): ({'sdf'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Removing single pathed devices sdf {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e541862-a651-4a24-98ab-d38e50827427]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54cfb1e-f728-4263-8289-2df923f8f687]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flushing IO for device /dev/sdf {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a808edeb-51da-4726-9662-cc5ff1f1a224]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a2da8b-9c56-49c5-baa5-cdccdf73c554]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] SCSI volumes sdf have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[511ecb7f-f07f-4bf6-b3bb-9bb9993b419a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ddbe3-4050-4cf7-ad1f-97fff2785527]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260]
Aug 17 08:28:21 user nova-compute[72998]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260] successful.
Aug 17 08:28:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cb76ab-4df9-424b-9aaa-7416970f9d94]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== disconnect_volume: return (297ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Start _get_guest_xml network_info=[{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'beb12b95-1a16-4574-bdec-6d86c5dd1c47', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnTEULqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '87850ffb-dfa9-4b23-bd18-938744cd9b5f', 'attached_at': '', 'detached_at': '', 'volume_id': '4d238b32-97a2-429c-9d30-6ce0a87a2986', 'serial': '4d238b32-97a2-429c-9d30-6ce0a87a2986'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'numa_topology' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:21 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:28:21 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnTEULqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:28:21 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:28:21 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:28:21 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[368056af-4b7f-48ae-91de-910842f2e498]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:28:21 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e7d10f-7d47-458d-89d6-3b5a17c404ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986] added
Aug 17 08:28:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd5a1d4-c52f-4573-a242-5e6f35760185]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf50f0f3-a8d2-42e4-9589-d3cf5a6c9ea7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnTEULqa {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnTEULqa" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ed5545-d3b4-4a21-a7c8-af532bde0411]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnTEULqa'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07ddf32-46e0-4df4-b664-9fe30eb09fec]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9ac58e-d01c-4149-8c13-0fe74edf91d5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e96100d-9ed7-443d-b990-8aadab163572]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260]
Aug 17 08:28:21 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260] successful.
Aug 17 08:28:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d745c3a8-5b78-4e62-9cb5-d42b4bdc9378]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb5b4b1-e0e4-4b32-b82e-f61ba4c1a959]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b235d9-a73f-4d3b-9081-b82d2bf29dca]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:28:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnTEULqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:28:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:28:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26163346661636131', 'path': '/dev/sde'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:28:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163346661636131', 'path': '/dev/sde'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:28:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1003522619',display_name='tempest-AttachVolumeTestJSON-server-1003522619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1003522619',id=22,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmc8qbkgbu95dJvwY1bo5kn9RJpsYoyrns3+CWvhffMSTP6KyY1SbvmOYfexUjDzD3737D3c8fhHlVWQh2nyWElT5uU1HwkwSVrOW/xi1hx6Ymm9am4ZS8Qy8EFRomqnw==',key_name='tempest-keypair-346425477',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-h31cebic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=87850ffb-dfa9-4b23-bd18-938744cd9b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:28:22 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:28:22 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:28:22 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'pci_devices' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:28:22 user nova-compute[72998]:   <uuid>87850ffb-dfa9-4b23-bd18-938744cd9b5f</uuid>
Aug 17 08:28:22 user nova-compute[72998]:   <name>instance-00000016</name>
Aug 17 08:28:22 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:28:22 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:28:22 user nova-compute[72998]:   <metadata>
Aug 17 08:28:22 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:28:22 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:28:22 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeTestJSON-server-1003522619</nova:name>
Aug 17 08:28:22 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:28:21</nova:creationTime>
Aug 17 08:28:22 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:28:22 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:28:22 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:28:22 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:28:22 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:28:22 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:28:22 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:28:22 user nova-compute[72998]:       <nova:owner>
Aug 17 08:28:22 user nova-compute[72998]:         <nova:user uuid="dedd991048b34559acc5465faf521198">tempest-AttachVolumeTestJSON-1538733103-project-member</nova:user>
Aug 17 08:28:22 user nova-compute[72998]:         <nova:project uuid="be77012255394ad0bab402375507d6ef">tempest-AttachVolumeTestJSON-1538733103</nova:project>
Aug 17 08:28:22 user nova-compute[72998]:       </nova:owner>
Aug 17 08:28:22 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:28:22 user nova-compute[72998]:       <nova:ports>
Aug 17 08:28:22 user nova-compute[72998]:         <nova:port uuid="85901016-fa8e-4d52-9229-caa63c02bea3">
Aug 17 08:28:22 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 08:28:22 user nova-compute[72998]:         </nova:port>
Aug 17 08:28:22 user nova-compute[72998]:       </nova:ports>
Aug 17 08:28:22 user nova-compute[72998]:     </nova:instance>
Aug 17 08:28:22 user nova-compute[72998]:   </metadata>
Aug 17 08:28:22 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:28:22 user nova-compute[72998]:     <system>
Aug 17 08:28:22 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:28:22 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:28:22 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:28:22 user nova-compute[72998]:       <entry name="serial">87850ffb-dfa9-4b23-bd18-938744cd9b5f</entry>
Aug 17 08:28:22 user nova-compute[72998]:       <entry name="uuid">87850ffb-dfa9-4b23-bd18-938744cd9b5f</entry>
Aug 17 08:28:22 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:28:22 user nova-compute[72998]:     </system>
Aug 17 08:28:22 user nova-compute[72998]:   </sysinfo>
Aug 17 08:28:22 user nova-compute[72998]:   <os>
Aug 17 08:28:22 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:28:22 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:28:22 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:28:22 user nova-compute[72998]:   </os>
Aug 17 08:28:22 user nova-compute[72998]:   <features>
Aug 17 08:28:22 user nova-compute[72998]:     <acpi/>
Aug 17 08:28:22 user nova-compute[72998]:     <apic/>
Aug 17 08:28:22 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:28:22 user nova-compute[72998]:   </features>
Aug 17 08:28:22 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:28:22 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:28:22 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:28:22 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:28:22 user nova-compute[72998]:   </clock>
Aug 17 08:28:22 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:28:22 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:28:22 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:28:22 user nova-compute[72998]:   </cpu>
Aug 17 08:28:22 user nova-compute[72998]:   <devices>
Aug 17 08:28:22 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:28:22 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:28:22 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk"/>
Aug 17 08:28:22 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:28:22 user nova-compute[72998]:     </disk>
Aug 17 08:28:22 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:28:22 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:28:22 user nova-compute[72998]:       <source dev="/dev/sde"/>
Aug 17 08:28:22 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:28:22 user nova-compute[72998]:       <serial>4d238b32-97a2-429c-9d30-6ce0a87a2986</serial>
Aug 17 08:28:22 user nova-compute[72998]:     </disk>
Aug 17 08:28:22 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:28:22 user nova-compute[72998]:       <mac address="fa:16:3e:9c:31:a6"/>
Aug 17 08:28:22 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:28:22 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:28:22 user nova-compute[72998]:       <target dev="tap85901016-fa"/>
Aug 17 08:28:22 user nova-compute[72998]:     </interface>
Aug 17 08:28:22 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:28:22 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/console.log" append="off"/>
Aug 17 08:28:22 user nova-compute[72998]:     </serial>
Aug 17 08:28:22 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:28:22 user nova-compute[72998]:     <video>
Aug 17 08:28:22 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:28:22 user nova-compute[72998]:     </video>
Aug 17 08:28:22 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:28:22 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:28:22 user nova-compute[72998]:     </rng>
Aug 17 08:28:22 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:28:22 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:28:22 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:28:22 user nova-compute[72998]:     </memballoon>
Aug 17 08:28:22 user nova-compute[72998]:   </devices>
Aug 17 08:28:22 user nova-compute[72998]: </domain>
Aug 17 08:28:22 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:28:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Cannot resize image /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'migration_context' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1003522619',display_name='tempest-AttachVolumeTestJSON-server-1003522619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1003522619',id=22,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmc8qbkgbu95dJvwY1bo5kn9RJpsYoyrns3+CWvhffMSTP6KyY1SbvmOYfexUjDzD3737D3c8fhHlVWQh2nyWElT5uU1HwkwSVrOW/xi1hx6Ymm9am4ZS8Qy8EFRomqnw==',key_name='tempest-keypair-346425477',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-h31cebic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=87850ffb-dfa9-4b23-bd18-938744cd9b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG os_vif [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85901016-fa, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85901016-fa, col_values=(('external_ids', {'iface-id': '85901016-fa8e-4d52-9229-caa63c02bea3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:31:a6', 'vm-uuid': '87850ffb-dfa9-4b23-bd18-938744cd9b5f'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:28:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:23 user nova-compute[72998]: INFO os_vif [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa')
Aug 17 08:28:24 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260889.0972528, 4119f28a-b9f1-4996-a144-68edd4f08c44 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:24 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] VM Stopped (Lifecycle Event)
Aug 17 08:28:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f03c8659-8805-44b5-bf1e-2ed27a72b339 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f03c8659-8805-44b5-bf1e-2ed27a72b339 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:28:24 user nova-compute[72998]: INFO nova.compute.manager [None req-f03c8659-8805-44b5-bf1e-2ed27a72b339 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 08:28:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-393ae681-402a-489a-84ee-efeff9fbb522 req-e85fb3dc-5858-41f0-9a29-f2fd91a2c8f1 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-393ae681-402a-489a-84ee-efeff9fbb522 req-e85fb3dc-5858-41f0-9a29-f2fd91a2c8f1 service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-393ae681-402a-489a-84ee-efeff9fbb522 req-e85fb3dc-5858-41f0-9a29-f2fd91a2c8f1 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-393ae681-402a-489a-84ee-efeff9fbb522 req-e85fb3dc-5858-41f0-9a29-f2fd91a2c8f1 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-393ae681-402a-489a-84ee-efeff9fbb522 req-e85fb3dc-5858-41f0-9a29-f2fd91a2c8f1 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:25 user nova-compute[72998]: WARNING nova.compute.manager [req-393ae681-402a-489a-84ee-efeff9fbb522 req-e85fb3dc-5858-41f0-9a29-f2fd91a2c8f1 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state stopped and task_state powering-on.
Aug 17 08:28:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:25 user nova-compute[72998]: INFO nova.compute.manager [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Terminating instance
Aug 17 08:28:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Instance destroyed successfully.
Aug 17 08:28:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lazy-loading 'resources' on Instance uuid d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-671479913',display_name='tempest-VolumesActionsTest-instance-671479913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-671479913',id=27,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:26:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='310f3d4efad24fe59257fdc9be8723d7',ramdisk_id='',reservation_id='r-nda62qwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-188754561',owner_user_name='tempest-VolumesActionsTest-188754561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:26:41Z,user_data=None,user_id='d1165511c08f4cb08358007fed3c2e5b',uuid=d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converting VIF {"id": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "address": "fa:16:3e:7c:6e:d4", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa1dce5-d7", "ovs_interfaceid": "2fa1dce5-d780-4012-82ca-279d4f2bdb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:d4,bridge_name='br-int',has_traffic_filtering=True,id=2fa1dce5-d780-4012-82ca-279d4f2bdb16,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa1dce5-d7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG os_vif [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:d4,bridge_name='br-int',has_traffic_filtering=True,id=2fa1dce5-d780-4012-82ca-279d4f2bdb16,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa1dce5-d7') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fa1dce5-d7, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:25 user nova-compute[72998]: INFO os_vif [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:d4,bridge_name='br-int',has_traffic_filtering=True,id=2fa1dce5-d780-4012-82ca-279d4f2bdb16,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa1dce5-d7')
Aug 17 08:28:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Deleting instance files /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0_del
Aug 17 08:28:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Deletion of /opt/stack/data/nova/instances/d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0_del complete
Aug 17 08:28:26 user nova-compute[72998]: INFO nova.compute.manager [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 17 08:28:26 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:28:26 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:28:26 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:28:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:26 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:26 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Took 0.68 seconds to deallocate network for instance.
Aug 17 08:28:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-53def529-fdd6-440b-a5c1-23ab6b986e97 req-f118628a-7982-4871-8c3a-e0466ba6a775 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received event network-vif-deleted-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:26 user nova-compute[72998]: INFO nova.compute.manager [req-53def529-fdd6-440b-a5c1-23ab6b986e97 req-f118628a-7982-4871-8c3a-e0466ba6a775 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Neutron deleted interface 2fa1dce5-d780-4012-82ca-279d4f2bdb16; detaching it from the instance and deleting it from the info cache
Aug 17 08:28:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-53def529-fdd6-440b-a5c1-23ab6b986e97 req-f118628a-7982-4871-8c3a-e0466ba6a775 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-53def529-fdd6-440b-a5c1-23ab6b986e97 req-f118628a-7982-4871-8c3a-e0466ba6a775 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Detach interface failed, port_id=2fa1dce5-d780-4012-82ca-279d4f2bdb16, reason: Instance d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:28:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:27 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Deleted allocations for instance d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260907.2618513, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:27 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] VM Resumed (Lifecycle Event)
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:28:27 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance rebooted successfully.
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-be286ac1-86b5-4576-acc6-56600b1218a4 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:27 user nova-compute[72998]: WARNING nova.compute.manager [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state stopped and task_state powering-on.
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received event network-vif-unplugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] Acquiring lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] No waiting events found dispatching network-vif-unplugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:27 user nova-compute[72998]: WARNING nova.compute.manager [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received unexpected event network-vif-unplugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 for instance with vm_state deleted and task_state None.
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received event network-vif-plugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] Acquiring lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] No waiting events found dispatching network-vif-plugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:27 user nova-compute[72998]: WARNING nova.compute.manager [req-a7611083-27cc-4462-a5fc-c58e16d86e7b req-75df4d0a-634f-4e70-8fee-faf88a05b9b3 service nova] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Received unexpected event network-vif-plugged-2fa1dce5-d780-4012-82ca-279d4f2bdb16 for instance with vm_state deleted and task_state None.
Aug 17 08:28:27 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260907.2646496, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:27 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] VM Started (Lifecycle Event)
Aug 17 08:28:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-baad1871-267f-4184-9793-6427700387a4 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.999s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:28:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-623d119c-b128-4e33-9518-19197571b0d1 req-1b31ffc5-8c29-4444-8fc5-2ee7b1f1f7b3 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-changed-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-623d119c-b128-4e33-9518-19197571b0d1 req-1b31ffc5-8c29-4444-8fc5-2ee7b1f1f7b3 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Refreshing instance network info cache due to event network-changed-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-623d119c-b128-4e33-9518-19197571b0d1 req-1b31ffc5-8c29-4444-8fc5-2ee7b1f1f7b3 service nova] Acquiring lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-623d119c-b128-4e33-9518-19197571b0d1 req-1b31ffc5-8c29-4444-8fc5-2ee7b1f1f7b3 service nova] Acquired lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-623d119c-b128-4e33-9518-19197571b0d1 req-1b31ffc5-8c29-4444-8fc5-2ee7b1f1f7b3 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Refreshing network info cache for port 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:35 user nova-compute[72998]: INFO nova.compute.manager [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Detaching volume 84a0c0ad-efde-4cea-83d6-9dc42122bcba
Aug 17 08:28:35 user nova-compute[72998]: INFO nova.virt.block_device [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Attempting to driver detach volume 84a0c0ad-efde-4cea-83d6-9dc42122bcba from mountpoint /dev/vdb
Aug 17 08:28:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Attempting to detach device vdb from instance 8067a647-dca0-47d4-a472-eac43a2e4de6 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:28:35 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:28:35 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:28:35 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:28:35 user nova-compute[72998]:   <serial>84a0c0ad-efde-4cea-83d6-9dc42122bcba</serial>
Aug 17 08:28:35 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:28:35 user nova-compute[72998]: </disk>
Aug 17 08:28:35 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:28:35 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Successfully detached device vdb from instance 8067a647-dca0-47d4-a472-eac43a2e4de6 from the persistent domain config.
Aug 17 08:28:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8067a647-dca0-47d4-a472-eac43a2e4de6 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:28:35 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:28:35 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:28:35 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:28:35 user nova-compute[72998]:   <serial>84a0c0ad-efde-4cea-83d6-9dc42122bcba</serial>
Aug 17 08:28:35 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:28:35 user nova-compute[72998]: </disk>
Aug 17 08:28:35 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-623d119c-b128-4e33-9518-19197571b0d1 req-1b31ffc5-8c29-4444-8fc5-2ee7b1f1f7b3 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updated VIF entry in instance network info cache for port 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-623d119c-b128-4e33-9518-19197571b0d1 req-1b31ffc5-8c29-4444-8fc5-2ee7b1f1f7b3 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updating instance_info_cache with network_info: [{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-623d119c-b128-4e33-9518-19197571b0d1 req-1b31ffc5-8c29-4444-8fc5-2ee7b1f1f7b3 service nova] Releasing lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:28:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692260916.1034055, 8067a647-dca0-47d4-a472-eac43a2e4de6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:28:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Successfully detached device vdb from instance 8067a647-dca0-47d4-a472-eac43a2e4de6 from the live domain config.
Aug 17 08:28:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPlbJoyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:28:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bf6c54-b542-4195-b3c0-def051bb89a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d77263-50b4-4092-8a4e-73d1375548d8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:36 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:36 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:36 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba (non-flash)
Aug 17 08:28:36 user nova-compute[72998]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:36 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:36 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4b7a70160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c62ad-cc9a-48b9-b090-6b89c6cbc4fb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0f545-3293-4e9e-ae3a-987c2d0a3b36]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c198b029-8093-43f2-a3af-dde0fdcbdf79]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a0db6b-6a84-422e-a3ea-fdba7e534e14]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d24f034-48ba-4bbe-81b2-9b85af7ccb7f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8866871-7bf2-46f6-b078-3a6f09463b4c]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba, portal: 172.16.0.220,3260]
Aug 17 08:28:36 user nova-compute[72998]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba, portal: 172.16.0.220,3260] successful.
Aug 17 08:28:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84a0c0ad-efde-4cea-83d6-9dc42122bcba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ac1535-c878-4296-a7b6-7d2a84e6353d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] <== disconnect_volume: return (285ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:28:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-3c7dd5cb-0033-45c5-8355-671b0cbc406c req-2c7d940f-4168-44b5-b534-9c051ac3f142 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-changed-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-3c7dd5cb-0033-45c5-8355-671b0cbc406c req-2c7d940f-4168-44b5-b534-9c051ac3f142 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Refreshing instance network info cache due to event network-changed-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3c7dd5cb-0033-45c5-8355-671b0cbc406c req-2c7d940f-4168-44b5-b534-9c051ac3f142 service nova] Acquiring lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3c7dd5cb-0033-45c5-8355-671b0cbc406c req-2c7d940f-4168-44b5-b534-9c051ac3f142 service nova] Acquired lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-3c7dd5cb-0033-45c5-8355-671b0cbc406c req-2c7d940f-4168-44b5-b534-9c051ac3f142 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Refreshing network info cache for port 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG nova.objects.instance [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'flavor' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-96a6eb22-789a-4e49-b767-d492017c9460 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-3c7dd5cb-0033-45c5-8355-671b0cbc406c req-2c7d940f-4168-44b5-b534-9c051ac3f142 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updated VIF entry in instance network info cache for port 8a57b8a0-b04f-4299-8344-e5c0f2b11bc6. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-3c7dd5cb-0033-45c5-8355-671b0cbc406c req-2c7d940f-4168-44b5-b534-9c051ac3f142 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updating instance_info_cache with network_info: [{"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3c7dd5cb-0033-45c5-8355-671b0cbc406c req-2c7d940f-4168-44b5-b534-9c051ac3f142 service nova] Releasing lock "refresh_cache-8067a647-dca0-47d4-a472-eac43a2e4de6" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:28:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:40 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260905.950857, d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:40 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] VM Stopped (Lifecycle Event)
Aug 17 08:28:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0edad9ef-5a48-4e40-bb40-6c943c577c3b None None] [instance: d0e2d0a3-0ff1-4098-9f14-f1235eea9ff0] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Starting finish_migration {{(pid=72998) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 08:28:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance directory exists: not creating {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 08:28:41 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Creating image(s)
Aug 17 08:28:41 user nova-compute[72998]: DEBUG nova.objects.instance [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:41 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk. size=21474836480 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:28:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk 21474836480 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk 21474836480" returned: 0 in 0.046s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Ensure instance console log exists: /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Start _get_guest_xml network_info=[{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1268549478-network", "vif_mac": "fa:16:3e:36:9d:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'db72cdc9-6e4f-4b6a-b7af-6c08feafb7a0', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4119f28a-b9f1-4996-a144-68edd4f08c44', 'attached_at': '2023-08-17T08:28:42.000000', 'detached_at': '', 'volume_id': '3c6d5e7f-f3b0-4c02-983b-4594be7d8551', 'serial': '3c6d5e7f-f3b0-4c02-983b-4594be7d8551'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:28:42 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:28:42 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.objects.instance [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:28:42 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:28:42 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:28:42 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[843238f4-cd3b-4998-907f-dd19d409f643]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:28:42 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba48007-11c4-4e44-bfc0-7910a5eb846b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551] added
Aug 17 08:28:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffe4725-de58-45c1-8405-831950a4d683]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[93282a02-acdb-4573-aca5-29cfbb49af7b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCyoBIwl {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCyoBIwl" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a79a90f-a114-4b96-9fcf-215a74c61b4c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JCyoBIwl'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c174d9-1506-4328-bdff-c0bee82a4abe]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11d2f0a-df76-40d1-90ae-77c363a96a4d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ccdda1-df24-4a9a-9178-cae805e8d6fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]
Aug 17 08:28:42 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.
Aug 17 08:28:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abc5dd5-b7df-4e17-8376-997c93f1f47e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aa1f01-94f2-4aed-8008-7ba6c357400b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:28:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[be26f908-423e-40a8-bc5b-95353b089b46]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:28:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26333346466303963', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333346466303963', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1893379751',display_name='tempest-ServerActionsTestOtherB-server-1893379751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1893379751',id=21,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1sywPS7noB6enRkafRCV4V8gUajrQp1IvyFeTNyX5oNNHzp72oZWl7JWE9EVMF5YzyYJVOw45540lSzJ/aE8AmU535jNS6dcszNW9Kp6/r+UbKETYBcWkdMqhnsqo26g==',key_name='tempest-keypair-2137913041',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='90f94111e9fa4659a975f8478d7ca7da',ramdisk_id='',reservation_id='r-t6pdxe0v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1997511094',owner_user_name='tempest-ServerActionsTestOtherB-1997511094-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cbf4e4b883f484980af4bde95f8fd88',uuid=4119f28a-b9f1-4996-a144-68edd4f08c44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1268549478-network", "vif_mac": "fa:16:3e:36:9d:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converting VIF {"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1268549478-network", "vif_mac": "fa:16:3e:36:9d:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:28:43 user nova-compute[72998]:   <uuid>4119f28a-b9f1-4996-a144-68edd4f08c44</uuid>
Aug 17 08:28:43 user nova-compute[72998]:   <name>instance-00000015</name>
Aug 17 08:28:43 user nova-compute[72998]:   <memory>2097152</memory>
Aug 17 08:28:43 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:28:43 user nova-compute[72998]:   <metadata>
Aug 17 08:28:43 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:28:43 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:28:43 user nova-compute[72998]:       <nova:name>tempest-ServerActionsTestOtherB-server-1893379751</nova:name>
Aug 17 08:28:43 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:28:42</nova:creationTime>
Aug 17 08:28:43 user nova-compute[72998]:       <nova:flavor name="m1.small">
Aug 17 08:28:43 user nova-compute[72998]:         <nova:memory>2048</nova:memory>
Aug 17 08:28:43 user nova-compute[72998]:         <nova:disk>20</nova:disk>
Aug 17 08:28:43 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:28:43 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:28:43 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:28:43 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:28:43 user nova-compute[72998]:       <nova:owner>
Aug 17 08:28:43 user nova-compute[72998]:         <nova:user uuid="9cbf4e4b883f484980af4bde95f8fd88">tempest-ServerActionsTestOtherB-1997511094-project-member</nova:user>
Aug 17 08:28:43 user nova-compute[72998]:         <nova:project uuid="90f94111e9fa4659a975f8478d7ca7da">tempest-ServerActionsTestOtherB-1997511094</nova:project>
Aug 17 08:28:43 user nova-compute[72998]:       </nova:owner>
Aug 17 08:28:43 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:28:43 user nova-compute[72998]:       <nova:ports>
Aug 17 08:28:43 user nova-compute[72998]:         <nova:port uuid="e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3">
Aug 17 08:28:43 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 08:28:43 user nova-compute[72998]:         </nova:port>
Aug 17 08:28:43 user nova-compute[72998]:       </nova:ports>
Aug 17 08:28:43 user nova-compute[72998]:     </nova:instance>
Aug 17 08:28:43 user nova-compute[72998]:   </metadata>
Aug 17 08:28:43 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:28:43 user nova-compute[72998]:     <system>
Aug 17 08:28:43 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:28:43 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:28:43 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:28:43 user nova-compute[72998]:       <entry name="serial">4119f28a-b9f1-4996-a144-68edd4f08c44</entry>
Aug 17 08:28:43 user nova-compute[72998]:       <entry name="uuid">4119f28a-b9f1-4996-a144-68edd4f08c44</entry>
Aug 17 08:28:43 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:28:43 user nova-compute[72998]:     </system>
Aug 17 08:28:43 user nova-compute[72998]:   </sysinfo>
Aug 17 08:28:43 user nova-compute[72998]:   <os>
Aug 17 08:28:43 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:28:43 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:28:43 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:28:43 user nova-compute[72998]:   </os>
Aug 17 08:28:43 user nova-compute[72998]:   <features>
Aug 17 08:28:43 user nova-compute[72998]:     <acpi/>
Aug 17 08:28:43 user nova-compute[72998]:     <apic/>
Aug 17 08:28:43 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:28:43 user nova-compute[72998]:   </features>
Aug 17 08:28:43 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:28:43 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:28:43 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:28:43 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:28:43 user nova-compute[72998]:   </clock>
Aug 17 08:28:43 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:28:43 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:28:43 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:28:43 user nova-compute[72998]:   </cpu>
Aug 17 08:28:43 user nova-compute[72998]:   <devices>
Aug 17 08:28:43 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:28:43 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:28:43 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk"/>
Aug 17 08:28:43 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:28:43 user nova-compute[72998]:     </disk>
Aug 17 08:28:43 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:28:43 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:28:43 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 08:28:43 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:28:43 user nova-compute[72998]:       <serial>3c6d5e7f-f3b0-4c02-983b-4594be7d8551</serial>
Aug 17 08:28:43 user nova-compute[72998]:     </disk>
Aug 17 08:28:43 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:28:43 user nova-compute[72998]:       <mac address="fa:16:3e:36:9d:90"/>
Aug 17 08:28:43 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:28:43 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:28:43 user nova-compute[72998]:       <target dev="tape9cd3f5a-80"/>
Aug 17 08:28:43 user nova-compute[72998]:     </interface>
Aug 17 08:28:43 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:28:43 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/console.log" append="off"/>
Aug 17 08:28:43 user nova-compute[72998]:     </serial>
Aug 17 08:28:43 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:28:43 user nova-compute[72998]:     <video>
Aug 17 08:28:43 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:28:43 user nova-compute[72998]:     </video>
Aug 17 08:28:43 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:28:43 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:28:43 user nova-compute[72998]:     </rng>
Aug 17 08:28:43 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:28:43 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:28:43 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:28:43 user nova-compute[72998]:     </memballoon>
Aug 17 08:28:43 user nova-compute[72998]:   </devices>
Aug 17 08:28:43 user nova-compute[72998]: </domain>
Aug 17 08:28:43 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1893379751',display_name='tempest-ServerActionsTestOtherB-server-1893379751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1893379751',id=21,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1sywPS7noB6enRkafRCV4V8gUajrQp1IvyFeTNyX5oNNHzp72oZWl7JWE9EVMF5YzyYJVOw45540lSzJ/aE8AmU535jNS6dcszNW9Kp6/r+UbKETYBcWkdMqhnsqo26g==',key_name='tempest-keypair-2137913041',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='90f94111e9fa4659a975f8478d7ca7da',ramdisk_id='',reservation_id='r-t6pdxe0v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1997511094',owner_user_name='tempest-ServerActionsTestOtherB-1997511094-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cbf4e4b883f484980af4bde95f8fd88',uuid=4119f28a-b9f1-4996-a144-68edd4f08c44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1268549478-network", "vif_mac": "fa:16:3e:36:9d:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converting VIF {"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1268549478-network", "vif_mac": "fa:16:3e:36:9d:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG os_vif [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9cd3f5a-80, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9cd3f5a-80, col_values=(('external_ids', {'iface-id': 'e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:9d:90', 'vm-uuid': '4119f28a-b9f1-4996-a144-68edd4f08c44'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:43 user nova-compute[72998]: INFO os_vif [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80')
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:28:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] No VIF found with MAC fa:16:3e:36:9d:90, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-325bf681-57d2-4b98-adcc-41ab1b55d66e req-baeba407-dbf1-420d-b4d5-0d908a1a2229 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-325bf681-57d2-4b98-adcc-41ab1b55d66e req-baeba407-dbf1-420d-b4d5-0d908a1a2229 service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-325bf681-57d2-4b98-adcc-41ab1b55d66e req-baeba407-dbf1-420d-b4d5-0d908a1a2229 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-325bf681-57d2-4b98-adcc-41ab1b55d66e req-baeba407-dbf1-420d-b4d5-0d908a1a2229 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-325bf681-57d2-4b98-adcc-41ab1b55d66e req-baeba407-dbf1-420d-b4d5-0d908a1a2229 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:45 user nova-compute[72998]: WARNING nova.compute.manager [req-325bf681-57d2-4b98-adcc-41ab1b55d66e req-baeba407-dbf1-420d-b4d5-0d908a1a2229 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state resize_finish.
Aug 17 08:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260927.1854126, 4119f28a-b9f1-4996-a144-68edd4f08c44 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] VM Resumed (Lifecycle Event)
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:28:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance running successfully.
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Failed to set time: agent not configured {{(pid=72998) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-caf7ba53-85d9-453a-8b9c-15e05d2ff5ea tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] finish_migration finished successfully. {{(pid=72998) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:28:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260927.188436, 4119f28a-b9f1-4996-a144-68edd4f08c44 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] VM Started (Lifecycle Event)
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:28:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-8fee2c57-8315-40f4-95ac-b7a89c095863 req-bf8aa9ae-077b-4b37-bca4-dfd90c04015f service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8fee2c57-8315-40f4-95ac-b7a89c095863 req-bf8aa9ae-077b-4b37-bca4-dfd90c04015f service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8fee2c57-8315-40f4-95ac-b7a89c095863 req-bf8aa9ae-077b-4b37-bca4-dfd90c04015f service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8fee2c57-8315-40f4-95ac-b7a89c095863 req-bf8aa9ae-077b-4b37-bca4-dfd90c04015f service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-8fee2c57-8315-40f4-95ac-b7a89c095863 req-bf8aa9ae-077b-4b37-bca4-dfd90c04015f service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:47 user nova-compute[72998]: WARNING nova.compute.manager [req-8fee2c57-8315-40f4-95ac-b7a89c095863 req-bf8aa9ae-077b-4b37-bca4-dfd90c04015f service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state resize_finish.
Aug 17 08:28:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:28:48 user nova-compute[72998]: INFO nova.compute.claims [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Claim successful on node user
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:28:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.policy [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '963659ce0d9c4e04bf345d4a98080e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6c1ee7c1e04088ae7a3e952743576c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:28:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Creating image(s)
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "/opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "/opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk 1073741824" returned: 0 in 0.052s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Successfully created port: aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Cannot resize image /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'migration_context' on Instance uuid cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Ensure instance console log exists: /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Successfully updated port: aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "refresh_cache-cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquired lock "refresh_cache-cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-b49725f0-7c89-4767-b440-5b0737fa6964 req-5500ed95-b809-4974-97b4-7abe517272e4 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received event network-changed-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-b49725f0-7c89-4767-b440-5b0737fa6964 req-5500ed95-b809-4974-97b4-7abe517272e4 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Refreshing instance network info cache due to event network-changed-aedfec88-8b06-4f74-a916-2d99204d272e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b49725f0-7c89-4767-b440-5b0737fa6964 req-5500ed95-b809-4974-97b4-7abe517272e4 service nova] Acquiring lock "refresh_cache-cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Updating instance_info_cache with network_info: [{"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Releasing lock "refresh_cache-cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Instance network_info: |[{"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b49725f0-7c89-4767-b440-5b0737fa6964 req-5500ed95-b809-4974-97b4-7abe517272e4 service nova] Acquired lock "refresh_cache-cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-b49725f0-7c89-4767-b440-5b0737fa6964 req-5500ed95-b809-4974-97b4-7abe517272e4 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Refreshing network info cache for port aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Start _get_guest_xml network_info=[{"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:28:50 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:28:50 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-731736617',display_name='tempest-VolumesSnapshotTestJSON-instance-731736617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-731736617',id=28,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1vtHf85dhCI/V20llhEJuwTCXMUeNJiO7ecPJjndYirvT63J6PWLYr+f0MCrMa4cKoNGMellcxiNX6+LGl/QBrj9LlQHLgmXffLtpBVUNA1TqjBH4eBa5THpXt6qAPTg==',key_name='tempest-keypair-1312878765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c1ee7c1e04088ae7a3e952743576c',ramdisk_id='',reservation_id='r-3rvzj2ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-20738309',owner_user_name='tempest-VolumesSnapshotTestJSON-20738309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='963659ce0d9c4e04bf345d4a98080e89',uuid=cc94ef0e-79ee-47c9-8e06-0e4c7f8db886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converting VIF {"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cb:13,bridge_name='br-int',has_traffic_filtering=True,id=aedfec88-8b06-4f74-a916-2d99204d272e,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaedfec88-8b') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'pci_devices' on Instance uuid cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:28:50 user nova-compute[72998]:   <uuid>cc94ef0e-79ee-47c9-8e06-0e4c7f8db886</uuid>
Aug 17 08:28:50 user nova-compute[72998]:   <name>instance-0000001c</name>
Aug 17 08:28:50 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:28:50 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:28:50 user nova-compute[72998]:   <metadata>
Aug 17 08:28:50 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:28:50 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:28:50 user nova-compute[72998]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-731736617</nova:name>
Aug 17 08:28:50 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:28:50</nova:creationTime>
Aug 17 08:28:50 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:28:50 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:28:50 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:28:50 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:28:50 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:28:50 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:28:50 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:28:50 user nova-compute[72998]:       <nova:owner>
Aug 17 08:28:50 user nova-compute[72998]:         <nova:user uuid="963659ce0d9c4e04bf345d4a98080e89">tempest-VolumesSnapshotTestJSON-20738309-project-member</nova:user>
Aug 17 08:28:50 user nova-compute[72998]:         <nova:project uuid="8f6c1ee7c1e04088ae7a3e952743576c">tempest-VolumesSnapshotTestJSON-20738309</nova:project>
Aug 17 08:28:50 user nova-compute[72998]:       </nova:owner>
Aug 17 08:28:50 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:28:50 user nova-compute[72998]:       <nova:ports>
Aug 17 08:28:50 user nova-compute[72998]:         <nova:port uuid="aedfec88-8b06-4f74-a916-2d99204d272e">
Aug 17 08:28:50 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 08:28:50 user nova-compute[72998]:         </nova:port>
Aug 17 08:28:50 user nova-compute[72998]:       </nova:ports>
Aug 17 08:28:50 user nova-compute[72998]:     </nova:instance>
Aug 17 08:28:50 user nova-compute[72998]:   </metadata>
Aug 17 08:28:50 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:28:50 user nova-compute[72998]:     <system>
Aug 17 08:28:50 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:28:50 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:28:50 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:28:50 user nova-compute[72998]:       <entry name="serial">cc94ef0e-79ee-47c9-8e06-0e4c7f8db886</entry>
Aug 17 08:28:50 user nova-compute[72998]:       <entry name="uuid">cc94ef0e-79ee-47c9-8e06-0e4c7f8db886</entry>
Aug 17 08:28:50 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:28:50 user nova-compute[72998]:     </system>
Aug 17 08:28:50 user nova-compute[72998]:   </sysinfo>
Aug 17 08:28:50 user nova-compute[72998]:   <os>
Aug 17 08:28:50 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:28:50 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:28:50 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:28:50 user nova-compute[72998]:   </os>
Aug 17 08:28:50 user nova-compute[72998]:   <features>
Aug 17 08:28:50 user nova-compute[72998]:     <acpi/>
Aug 17 08:28:50 user nova-compute[72998]:     <apic/>
Aug 17 08:28:50 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:28:50 user nova-compute[72998]:   </features>
Aug 17 08:28:50 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:28:50 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:28:50 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:28:50 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:28:50 user nova-compute[72998]:   </clock>
Aug 17 08:28:50 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:28:50 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:28:50 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:28:50 user nova-compute[72998]:   </cpu>
Aug 17 08:28:50 user nova-compute[72998]:   <devices>
Aug 17 08:28:50 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:28:50 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:28:50 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk"/>
Aug 17 08:28:50 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:28:50 user nova-compute[72998]:     </disk>
Aug 17 08:28:50 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:28:50 user nova-compute[72998]:       <mac address="fa:16:3e:fe:cb:13"/>
Aug 17 08:28:50 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:28:50 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:28:50 user nova-compute[72998]:       <target dev="tapaedfec88-8b"/>
Aug 17 08:28:50 user nova-compute[72998]:     </interface>
Aug 17 08:28:50 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:28:50 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/console.log" append="off"/>
Aug 17 08:28:50 user nova-compute[72998]:     </serial>
Aug 17 08:28:50 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:28:50 user nova-compute[72998]:     <video>
Aug 17 08:28:50 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:28:50 user nova-compute[72998]:     </video>
Aug 17 08:28:50 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:28:50 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:28:50 user nova-compute[72998]:     </rng>
Aug 17 08:28:50 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:28:50 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:28:50 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:28:50 user nova-compute[72998]:     </memballoon>
Aug 17 08:28:50 user nova-compute[72998]:   </devices>
Aug 17 08:28:50 user nova-compute[72998]: </domain>
Aug 17 08:28:50 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-731736617',display_name='tempest-VolumesSnapshotTestJSON-instance-731736617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-731736617',id=28,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1vtHf85dhCI/V20llhEJuwTCXMUeNJiO7ecPJjndYirvT63J6PWLYr+f0MCrMa4cKoNGMellcxiNX6+LGl/QBrj9LlQHLgmXffLtpBVUNA1TqjBH4eBa5THpXt6qAPTg==',key_name='tempest-keypair-1312878765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c1ee7c1e04088ae7a3e952743576c',ramdisk_id='',reservation_id='r-3rvzj2ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-20738309',owner_user_name='tempest-VolumesSnapshotTestJSON-20738309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='963659ce0d9c4e04bf345d4a98080e89',uuid=cc94ef0e-79ee-47c9-8e06-0e4c7f8db886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converting VIF {"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cb:13,bridge_name='br-int',has_traffic_filtering=True,id=aedfec88-8b06-4f74-a916-2d99204d272e,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaedfec88-8b') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG os_vif [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cb:13,bridge_name='br-int',has_traffic_filtering=True,id=aedfec88-8b06-4f74-a916-2d99204d272e,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaedfec88-8b') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaedfec88-8b, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaedfec88-8b, col_values=(('external_ids', {'iface-id': 'aedfec88-8b06-4f74-a916-2d99204d272e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:cb:13', 'vm-uuid': 'cc94ef0e-79ee-47c9-8e06-0e4c7f8db886'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:50 user nova-compute[72998]: INFO os_vif [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cb:13,bridge_name='br-int',has_traffic_filtering=True,id=aedfec88-8b06-4f74-a916-2d99204d272e,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaedfec88-8b')
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No VIF found with MAC fa:16:3e:fe:cb:13, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-b49725f0-7c89-4767-b440-5b0737fa6964 req-5500ed95-b809-4974-97b4-7abe517272e4 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Updated VIF entry in instance network info cache for port aedfec88-8b06-4f74-a916-2d99204d272e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-b49725f0-7c89-4767-b440-5b0737fa6964 req-5500ed95-b809-4974-97b4-7abe517272e4 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Updating instance_info_cache with network_info: [{"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:28:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b49725f0-7c89-4767-b440-5b0737fa6964 req-5500ed95-b809-4974-97b4-7abe517272e4 service nova] Releasing lock "refresh_cache-cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:28:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-cd2f5c98-8c63-45e1-a50f-6f5eacaaa9b2 req-7e467ed0-3519-44f8-a28d-9a1ea845e807 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received event network-vif-plugged-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cd2f5c98-8c63-45e1-a50f-6f5eacaaa9b2 req-7e467ed0-3519-44f8-a28d-9a1ea845e807 service nova] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cd2f5c98-8c63-45e1-a50f-6f5eacaaa9b2 req-7e467ed0-3519-44f8-a28d-9a1ea845e807 service nova] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cd2f5c98-8c63-45e1-a50f-6f5eacaaa9b2 req-7e467ed0-3519-44f8-a28d-9a1ea845e807 service nova] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-cd2f5c98-8c63-45e1-a50f-6f5eacaaa9b2 req-7e467ed0-3519-44f8-a28d-9a1ea845e807 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] No waiting events found dispatching network-vif-plugged-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:52 user nova-compute[72998]: WARNING nova.compute.manager [req-cd2f5c98-8c63-45e1-a50f-6f5eacaaa9b2 req-7e467ed0-3519-44f8-a28d-9a1ea845e807 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received unexpected event network-vif-plugged-aedfec88-8b06-4f74-a916-2d99204d272e for instance with vm_state building and task_state spawning.
Aug 17 08:28:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260934.268178, cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] VM Resumed (Lifecycle Event)
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:28:54 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Instance spawned successfully.
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-19fd6326-82ce-417a-ae74-d8c992d83fe2 req-e81c4e10-117e-465e-8ffd-ec6455c7667c service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received event network-vif-plugged-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-19fd6326-82ce-417a-ae74-d8c992d83fe2 req-e81c4e10-117e-465e-8ffd-ec6455c7667c service nova] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-19fd6326-82ce-417a-ae74-d8c992d83fe2 req-e81c4e10-117e-465e-8ffd-ec6455c7667c service nova] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-19fd6326-82ce-417a-ae74-d8c992d83fe2 req-e81c4e10-117e-465e-8ffd-ec6455c7667c service nova] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-19fd6326-82ce-417a-ae74-d8c992d83fe2 req-e81c4e10-117e-465e-8ffd-ec6455c7667c service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] No waiting events found dispatching network-vif-plugged-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:28:54 user nova-compute[72998]: WARNING nova.compute.manager [req-19fd6326-82ce-417a-ae74-d8c992d83fe2 req-e81c4e10-117e-465e-8ffd-ec6455c7667c service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received unexpected event network-vif-plugged-aedfec88-8b06-4f74-a916-2d99204d272e for instance with vm_state building and task_state spawning.
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:28:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260934.2714558, cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:28:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] VM Started (Lifecycle Event)
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:28:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:28:54 user nova-compute[72998]: INFO nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 17 08:28:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:28:54 user nova-compute[72998]: INFO nova.compute.manager [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Took 6.43 seconds to build instance.
Aug 17 08:28:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b161aed-0080-4feb-b6e2-17c70f6da3e4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.522s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:28:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:28:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:29:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:29:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:29:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:29:04 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updating instance_info_cache with network_info: [{"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:08 user nova-compute[72998]: INFO nova.compute.manager [None req-7ae3f55a-b191-4147-8018-f05ed2d39c40 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Unrescuing
Aug 17 08:29:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7ae3f55a-b191-4147-8018-f05ed2d39c40 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:29:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7ae3f55a-b191-4147-8018-f05ed2d39c40 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquired lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:29:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7ae3f55a-b191-4147-8018-f05ed2d39c40 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7ae3f55a-b191-4147-8018-f05ed2d39c40 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updating instance_info_cache with network_info: [{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7ae3f55a-b191-4147-8018-f05ed2d39c40 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Releasing lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7ae3f55a-b191-4147-8018-f05ed2d39c40 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'flavor' on Instance uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-5b71b924-338e-4e46-8bb1-ca8990af9eba req-caf404b3-e832-4c1d-bfe6-cdd8de296fa8 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-unplugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5b71b924-338e-4e46-8bb1-ca8990af9eba req-caf404b3-e832-4c1d-bfe6-cdd8de296fa8 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5b71b924-338e-4e46-8bb1-ca8990af9eba req-caf404b3-e832-4c1d-bfe6-cdd8de296fa8 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5b71b924-338e-4e46-8bb1-ca8990af9eba req-caf404b3-e832-4c1d-bfe6-cdd8de296fa8 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-5b71b924-338e-4e46-8bb1-ca8990af9eba req-caf404b3-e832-4c1d-bfe6-cdd8de296fa8 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-unplugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:09 user nova-compute[72998]: WARNING nova.compute.manager [req-5b71b924-338e-4e46-8bb1-ca8990af9eba req-caf404b3-e832-4c1d-bfe6-cdd8de296fa8 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-unplugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:29:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:29:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Instance destroyed successfully.
Aug 17 08:29:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:11 user nova-compute[72998]: WARNING nova.compute.manager [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:29:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:11 user nova-compute[72998]: WARNING nova.compute.manager [req-4258f750-e8d1-481a-a104-81400bf0eda7 req-db00c816-29b9-457f-890f-e5a1464363c2 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:29:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7ae3f55a-b191-4147-8018-f05ed2d39c40 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for d87b6f0b-95ce-41b2-b279-cab1f2d1175c due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260953.3057904, d87b6f0b-95ce-41b2-b279-cab1f2d1175c => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:29:13 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] VM Resumed (Lifecycle Event)
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:29:13 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260953.3060863, d87b6f0b-95ce-41b2-b279-cab1f2d1175c => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:29:13 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] VM Started (Lifecycle Event)
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-2d6a37ef-81b6-4efd-b77e-d722e771ea48 req-b1ff12ab-c3c9-4e7c-8b7b-d62e22631590 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2d6a37ef-81b6-4efd-b77e-d722e771ea48 req-b1ff12ab-c3c9-4e7c-8b7b-d62e22631590 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2d6a37ef-81b6-4efd-b77e-d722e771ea48 req-b1ff12ab-c3c9-4e7c-8b7b-d62e22631590 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2d6a37ef-81b6-4efd-b77e-d722e771ea48 req-b1ff12ab-c3c9-4e7c-8b7b-d62e22631590 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-2d6a37ef-81b6-4efd-b77e-d722e771ea48 req-b1ff12ab-c3c9-4e7c-8b7b-d62e22631590 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:13 user nova-compute[72998]: WARNING nova.compute.manager [req-2d6a37ef-81b6-4efd-b77e-d722e771ea48 req-b1ff12ab-c3c9-4e7c-8b7b-d62e22631590 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state active and task_state None.
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:29:15 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:29:15 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7438MB free_disk=24.034130096435547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Applying migration context for instance 603c6577-f34a-450d-a137-603469e19ede as it has an incoming, in-progress migration 89146928-ec99-45fb-b1cd-78994e0047bc. Migration status is finished {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Applying migration context for instance 4119f28a-b9f1-4996-a144-68edd4f08c44 as it has an incoming, in-progress migration f644891c-580d-4d34-a732-356f754a6ab5. Migration status is finished {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 08:29:15 user nova-compute[72998]: INFO nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating resource usage from migration 89146928-ec99-45fb-b1cd-78994e0047bc
Aug 17 08:29:15 user nova-compute[72998]: INFO nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating resource usage from migration f644891c-580d-4d34-a732-356f754a6ab5
Aug 17 08:29:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8067a647-dca0-47d4-a472-eac43a2e4de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Migration 89146928-ec99-45fb-b1cd-78994e0047bc is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 603c6577-f34a-450d-a137-603469e19ede actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Migration f644891c-580d-4d34-a732-356f754a6ab5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:29:15 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:29:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:29:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "14587314-30ee-4661-8800-bf1391b1500b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "14587314-30ee-4661-8800-bf1391b1500b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:29:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:16 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:29:16 user nova-compute[72998]: INFO nova.compute.claims [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Claim successful on node user
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:29:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.policy [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1165511c08f4cb08358007fed3c2e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310f3d4efad24fe59257fdc9be8723d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:29:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Creating image(s)
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "/opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "/opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "/opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.227s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk 1073741824" returned: 0 in 0.054s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Successfully created port: d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.187s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Cannot resize image /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lazy-loading 'migration_context' on Instance uuid 14587314-30ee-4661-8800-bf1391b1500b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Ensure instance console log exists: /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Successfully updated port: d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "refresh_cache-14587314-30ee-4661-8800-bf1391b1500b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquired lock "refresh_cache-14587314-30ee-4661-8800-bf1391b1500b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-3996fe49-1edc-4d58-b673-b99bcc13af61 req-8a537b34-d57d-4bc5-a56e-d4acdbc249f5 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received event network-changed-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-3996fe49-1edc-4d58-b673-b99bcc13af61 req-8a537b34-d57d-4bc5-a56e-d4acdbc249f5 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Refreshing instance network info cache due to event network-changed-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3996fe49-1edc-4d58-b673-b99bcc13af61 req-8a537b34-d57d-4bc5-a56e-d4acdbc249f5 service nova] Acquiring lock "refresh_cache-14587314-30ee-4661-8800-bf1391b1500b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Updating instance_info_cache with network_info: [{"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Releasing lock "refresh_cache-14587314-30ee-4661-8800-bf1391b1500b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Instance network_info: |[{"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3996fe49-1edc-4d58-b673-b99bcc13af61 req-8a537b34-d57d-4bc5-a56e-d4acdbc249f5 service nova] Acquired lock "refresh_cache-14587314-30ee-4661-8800-bf1391b1500b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.network.neutron [req-3996fe49-1edc-4d58-b673-b99bcc13af61 req-8a537b34-d57d-4bc5-a56e-d4acdbc249f5 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Refreshing network info cache for port d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Start _get_guest_xml network_info=[{"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:29:19 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:29:19 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1584276427',display_name='tempest-VolumesActionsTest-instance-1584276427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1584276427',id=29,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='310f3d4efad24fe59257fdc9be8723d7',ramdisk_id='',reservation_id='r-0356to74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-188754561',owner_user_name='tempest-VolumesActionsTest-188754561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:29:18Z,user_data=None,user_id='d1165511c08f4cb08358007fed3c2e5b',uuid=14587314-30ee-4661-8800-bf1391b1500b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converting VIF {"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:b2,bridge_name='br-int',has_traffic_filtering=True,id=d3b94e17-170c-4f51-a8b1-2f61b33a4bf8,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b94e17-17') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lazy-loading 'pci_devices' on Instance uuid 14587314-30ee-4661-8800-bf1391b1500b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:29:19 user nova-compute[72998]:   <uuid>14587314-30ee-4661-8800-bf1391b1500b</uuid>
Aug 17 08:29:19 user nova-compute[72998]:   <name>instance-0000001d</name>
Aug 17 08:29:19 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:29:19 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:29:19 user nova-compute[72998]:   <metadata>
Aug 17 08:29:19 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:29:19 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:29:19 user nova-compute[72998]:       <nova:name>tempest-VolumesActionsTest-instance-1584276427</nova:name>
Aug 17 08:29:19 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:29:19</nova:creationTime>
Aug 17 08:29:19 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:29:19 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:29:19 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:29:19 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:29:19 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:29:19 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:29:19 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:29:19 user nova-compute[72998]:       <nova:owner>
Aug 17 08:29:19 user nova-compute[72998]:         <nova:user uuid="d1165511c08f4cb08358007fed3c2e5b">tempest-VolumesActionsTest-188754561-project-member</nova:user>
Aug 17 08:29:19 user nova-compute[72998]:         <nova:project uuid="310f3d4efad24fe59257fdc9be8723d7">tempest-VolumesActionsTest-188754561</nova:project>
Aug 17 08:29:19 user nova-compute[72998]:       </nova:owner>
Aug 17 08:29:19 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:29:19 user nova-compute[72998]:       <nova:ports>
Aug 17 08:29:19 user nova-compute[72998]:         <nova:port uuid="d3b94e17-170c-4f51-a8b1-2f61b33a4bf8">
Aug 17 08:29:19 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 08:29:19 user nova-compute[72998]:         </nova:port>
Aug 17 08:29:19 user nova-compute[72998]:       </nova:ports>
Aug 17 08:29:19 user nova-compute[72998]:     </nova:instance>
Aug 17 08:29:19 user nova-compute[72998]:   </metadata>
Aug 17 08:29:19 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:29:19 user nova-compute[72998]:     <system>
Aug 17 08:29:19 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:29:19 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:29:19 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:29:19 user nova-compute[72998]:       <entry name="serial">14587314-30ee-4661-8800-bf1391b1500b</entry>
Aug 17 08:29:19 user nova-compute[72998]:       <entry name="uuid">14587314-30ee-4661-8800-bf1391b1500b</entry>
Aug 17 08:29:19 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:29:19 user nova-compute[72998]:     </system>
Aug 17 08:29:19 user nova-compute[72998]:   </sysinfo>
Aug 17 08:29:19 user nova-compute[72998]:   <os>
Aug 17 08:29:19 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:29:19 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:29:19 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:29:19 user nova-compute[72998]:   </os>
Aug 17 08:29:19 user nova-compute[72998]:   <features>
Aug 17 08:29:19 user nova-compute[72998]:     <acpi/>
Aug 17 08:29:19 user nova-compute[72998]:     <apic/>
Aug 17 08:29:19 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:29:19 user nova-compute[72998]:   </features>
Aug 17 08:29:19 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:29:19 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:29:19 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:29:19 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:29:19 user nova-compute[72998]:   </clock>
Aug 17 08:29:19 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:29:19 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:29:19 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:29:19 user nova-compute[72998]:   </cpu>
Aug 17 08:29:19 user nova-compute[72998]:   <devices>
Aug 17 08:29:19 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:29:19 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:29:19 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk"/>
Aug 17 08:29:19 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:29:19 user nova-compute[72998]:     </disk>
Aug 17 08:29:19 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:29:19 user nova-compute[72998]:       <mac address="fa:16:3e:56:91:b2"/>
Aug 17 08:29:19 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:29:19 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:29:19 user nova-compute[72998]:       <target dev="tapd3b94e17-17"/>
Aug 17 08:29:19 user nova-compute[72998]:     </interface>
Aug 17 08:29:19 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:29:19 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/console.log" append="off"/>
Aug 17 08:29:19 user nova-compute[72998]:     </serial>
Aug 17 08:29:19 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:29:19 user nova-compute[72998]:     <video>
Aug 17 08:29:19 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:29:19 user nova-compute[72998]:     </video>
Aug 17 08:29:19 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:29:19 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:29:19 user nova-compute[72998]:     </rng>
Aug 17 08:29:19 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:29:19 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:29:19 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:29:19 user nova-compute[72998]:     </memballoon>
Aug 17 08:29:19 user nova-compute[72998]:   </devices>
Aug 17 08:29:19 user nova-compute[72998]: </domain>
Aug 17 08:29:19 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1584276427',display_name='tempest-VolumesActionsTest-instance-1584276427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1584276427',id=29,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='310f3d4efad24fe59257fdc9be8723d7',ramdisk_id='',reservation_id='r-0356to74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-188754561',owner_user_name='tempest-VolumesActionsTest-188754561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:29:18Z,user_data=None,user_id='d1165511c08f4cb08358007fed3c2e5b',uuid=14587314-30ee-4661-8800-bf1391b1500b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converting VIF {"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:b2,bridge_name='br-int',has_traffic_filtering=True,id=d3b94e17-170c-4f51-a8b1-2f61b33a4bf8,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b94e17-17') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG os_vif [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:b2,bridge_name='br-int',has_traffic_filtering=True,id=d3b94e17-170c-4f51-a8b1-2f61b33a4bf8,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b94e17-17') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3b94e17-17, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3b94e17-17, col_values=(('external_ids', {'iface-id': 'd3b94e17-170c-4f51-a8b1-2f61b33a4bf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:91:b2', 'vm-uuid': '14587314-30ee-4661-8800-bf1391b1500b'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:19 user nova-compute[72998]: INFO os_vif [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:b2,bridge_name='br-int',has_traffic_filtering=True,id=d3b94e17-170c-4f51-a8b1-2f61b33a4bf8,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b94e17-17')
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:29:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] No VIF found with MAC fa:16:3e:56:91:b2, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:29:20 user nova-compute[72998]: DEBUG nova.network.neutron [req-3996fe49-1edc-4d58-b673-b99bcc13af61 req-8a537b34-d57d-4bc5-a56e-d4acdbc249f5 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Updated VIF entry in instance network info cache for port d3b94e17-170c-4f51-a8b1-2f61b33a4bf8. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:29:20 user nova-compute[72998]: DEBUG nova.network.neutron [req-3996fe49-1edc-4d58-b673-b99bcc13af61 req-8a537b34-d57d-4bc5-a56e-d4acdbc249f5 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Updating instance_info_cache with network_info: [{"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:29:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3996fe49-1edc-4d58-b673-b99bcc13af61 req-8a537b34-d57d-4bc5-a56e-d4acdbc249f5 service nova] Releasing lock "refresh_cache-14587314-30ee-4661-8800-bf1391b1500b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:29:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-12286c6b-dbec-4be2-ae2b-311c1e1e1e54 req-75b3037c-c245-4a44-99e8-3c41e555f8bb service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received event network-vif-plugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-12286c6b-dbec-4be2-ae2b-311c1e1e1e54 req-75b3037c-c245-4a44-99e8-3c41e555f8bb service nova] Acquiring lock "14587314-30ee-4661-8800-bf1391b1500b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-12286c6b-dbec-4be2-ae2b-311c1e1e1e54 req-75b3037c-c245-4a44-99e8-3c41e555f8bb service nova] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-12286c6b-dbec-4be2-ae2b-311c1e1e1e54 req-75b3037c-c245-4a44-99e8-3c41e555f8bb service nova] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-12286c6b-dbec-4be2-ae2b-311c1e1e1e54 req-75b3037c-c245-4a44-99e8-3c41e555f8bb service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] No waiting events found dispatching network-vif-plugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:21 user nova-compute[72998]: WARNING nova.compute.manager [req-12286c6b-dbec-4be2-ae2b-311c1e1e1e54 req-75b3037c-c245-4a44-99e8-3c41e555f8bb service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received unexpected event network-vif-plugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 for instance with vm_state building and task_state spawning.
Aug 17 08:29:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260963.2699206, 14587314-30ee-4661-8800-bf1391b1500b => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:29:23 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 14587314-30ee-4661-8800-bf1391b1500b] VM Resumed (Lifecycle Event)
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:29:23 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Instance spawned successfully.
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:29:23 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 14587314-30ee-4661-8800-bf1391b1500b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260963.2769585, 14587314-30ee-4661-8800-bf1391b1500b => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:29:23 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 14587314-30ee-4661-8800-bf1391b1500b] VM Started (Lifecycle Event)
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:29:23 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 14587314-30ee-4661-8800-bf1391b1500b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:29:23 user nova-compute[72998]: INFO nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-45ced949-5c52-4ad1-b6ea-5d3ef15e6b65 req-acc3076a-d865-4933-a0e6-bcef6bb3d801 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received event network-vif-plugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-45ced949-5c52-4ad1-b6ea-5d3ef15e6b65 req-acc3076a-d865-4933-a0e6-bcef6bb3d801 service nova] Acquiring lock "14587314-30ee-4661-8800-bf1391b1500b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-45ced949-5c52-4ad1-b6ea-5d3ef15e6b65 req-acc3076a-d865-4933-a0e6-bcef6bb3d801 service nova] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-45ced949-5c52-4ad1-b6ea-5d3ef15e6b65 req-acc3076a-d865-4933-a0e6-bcef6bb3d801 service nova] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-45ced949-5c52-4ad1-b6ea-5d3ef15e6b65 req-acc3076a-d865-4933-a0e6-bcef6bb3d801 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] No waiting events found dispatching network-vif-plugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:23 user nova-compute[72998]: WARNING nova.compute.manager [req-45ced949-5c52-4ad1-b6ea-5d3ef15e6b65 req-acc3076a-d865-4933-a0e6-bcef6bb3d801 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received unexpected event network-vif-plugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 for instance with vm_state building and task_state spawning.
Aug 17 08:29:23 user nova-compute[72998]: INFO nova.compute.manager [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Took 6.53 seconds to build instance.
Aug 17 08:29:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8c620837-7101-4c9d-915a-11e7ea589266 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "14587314-30ee-4661-8800-bf1391b1500b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.624s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:25 user nova-compute[72998]: INFO nova.compute.manager [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Terminating instance
Aug 17 08:29:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:29:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-05349195-1d87-4318-8fa3-0445066b0375 req-7c40d6ea-64b9-4c9d-95e1-88a9ddbce143 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-unplugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-05349195-1d87-4318-8fa3-0445066b0375 req-7c40d6ea-64b9-4c9d-95e1-88a9ddbce143 service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-05349195-1d87-4318-8fa3-0445066b0375 req-7c40d6ea-64b9-4c9d-95e1-88a9ddbce143 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-05349195-1d87-4318-8fa3-0445066b0375 req-7c40d6ea-64b9-4c9d-95e1-88a9ddbce143 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-05349195-1d87-4318-8fa3-0445066b0375 req-7c40d6ea-64b9-4c9d-95e1-88a9ddbce143 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-unplugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-05349195-1d87-4318-8fa3-0445066b0375 req-7c40d6ea-64b9-4c9d-95e1-88a9ddbce143 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-unplugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:29:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Instance destroyed successfully.
Aug 17 08:29:26 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'resources' on Instance uuid 8067a647-dca0-47d4-a472-eac43a2e4de6 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-102578514',display_name='tempest-ServerRescueNegativeTestJSON-server-102578514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-102578514',id=20,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2Lu0G+dEKk1ITN6VCSNKHeyC2omToYMreON1EfAfUAlW7eydb0N9uRZDyYvmASKGFmKM32HQSYdDfvkNjLnd5zm68d/pHA9Ch82ZE/niVKWuR0qmU+M0OzlxTY5N53hA==',key_name='tempest-keypair-1851076836',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-gyf5fjqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=8067a647-dca0-47d4-a472-eac43a2e4de6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "address": "fa:16:3e:37:2e:bb", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a57b8a0-b0", "ovs_interfaceid": "8a57b8a0-b04f-4299-8344-e5c0f2b11bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:2e:bb,bridge_name='br-int',has_traffic_filtering=True,id=8a57b8a0-b04f-4299-8344-e5c0f2b11bc6,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a57b8a0-b0') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG os_vif [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2e:bb,bridge_name='br-int',has_traffic_filtering=True,id=8a57b8a0-b04f-4299-8344-e5c0f2b11bc6,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a57b8a0-b0') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a57b8a0-b0, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:29:26 user nova-compute[72998]: INFO os_vif [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2e:bb,bridge_name='br-int',has_traffic_filtering=True,id=8a57b8a0-b04f-4299-8344-e5c0f2b11bc6,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a57b8a0-b0')
Aug 17 08:29:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Deleting instance files /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6_del
Aug 17 08:29:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Deletion of /opt/stack/data/nova/instances/8067a647-dca0-47d4-a472-eac43a2e4de6_del complete
Aug 17 08:29:26 user nova-compute[72998]: INFO nova.compute.manager [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 08:29:26 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:29:26 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:29:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:27 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:29:27 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Took 0.86 seconds to deallocate network for instance.
Aug 17 08:29:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-73fcdde6-2f48-4eb9-8535-430a6a916841 req-fe82d926-bd77-4efe-b91a-9dc382f3f1c9 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-deleted-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:28 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:29:28 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:29:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:28 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Deleted allocations for instance 8067a647-dca0-47d4-a472-eac43a2e4de6
Aug 17 08:29:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d41c14e9-961c-421a-8658-915d4078179c tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.313s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-67d8c6c2-8e01-4d77-b222-598d0528c442 req-b82febdf-439b-4095-9089-1e53fa57c266 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-67d8c6c2-8e01-4d77-b222-598d0528c442 req-b82febdf-439b-4095-9089-1e53fa57c266 service nova] Acquiring lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-67d8c6c2-8e01-4d77-b222-598d0528c442 req-b82febdf-439b-4095-9089-1e53fa57c266 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-67d8c6c2-8e01-4d77-b222-598d0528c442 req-b82febdf-439b-4095-9089-1e53fa57c266 service nova] Lock "8067a647-dca0-47d4-a472-eac43a2e4de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-67d8c6c2-8e01-4d77-b222-598d0528c442 req-b82febdf-439b-4095-9089-1e53fa57c266 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] No waiting events found dispatching network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:28 user nova-compute[72998]: WARNING nova.compute.manager [req-67d8c6c2-8e01-4d77-b222-598d0528c442 req-b82febdf-439b-4095-9089-1e53fa57c266 service nova] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Received unexpected event network-vif-plugged-8a57b8a0-b04f-4299-8344-e5c0f2b11bc6 for instance with vm_state deleted and task_state None.
Aug 17 08:29:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Going to confirm migration 1 {{(pid=72998) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 17 08:29:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:29:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquired lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:29:29 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:29:29 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'info_cache' on Instance uuid 603c6577-f34a-450d-a137-603469e19ede {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:30 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating instance_info_cache with network_info: [{"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Releasing lock "refresh_cache-603c6577-f34a-450d-a137-603469e19ede" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:29:30 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'migration_context' on Instance uuid 603c6577-f34a-450d-a137-603469e19ede {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:30 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:29:30 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.364s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:30 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Deleted allocation for migration 89146928-ec99-45fb-b1cd-78994e0047bc
Aug 17 08:29:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8578da51-756a-4aef-94e2-1b78080a9719 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.355s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:40 user nova-compute[72998]: INFO nova.compute.manager [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Unshelving
Aug 17 08:29:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:40 user nova-compute[72998]: DEBUG nova.objects.instance [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'pci_requests' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:40 user nova-compute[72998]: DEBUG nova.objects.instance [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'numa_topology' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:29:40 user nova-compute[72998]: INFO nova.compute.claims [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Claim successful on node user
Aug 17 08:29:40 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:29:40 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:29:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:40 user nova-compute[72998]: INFO nova.network.neutron [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updating port 5160fa81-e465-4cf0-b0a0-862256c60f8b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 08:29:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquired lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-eba955a2-45f6-4a8c-befa-9c5e5cc838e6 req-710a63e0-3ab6-4a9b-839c-a4bea957c7f4 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-changed-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-eba955a2-45f6-4a8c-befa-9c5e5cc838e6 req-710a63e0-3ab6-4a9b-839c-a4bea957c7f4 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Refreshing instance network info cache due to event network-changed-5160fa81-e465-4cf0-b0a0-862256c60f8b. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-eba955a2-45f6-4a8c-befa-9c5e5cc838e6 req-710a63e0-3ab6-4a9b-839c-a4bea957c7f4 service nova] Acquiring lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260966.6777408, 8067a647-dca0-47d4-a472-eac43a2e4de6 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:29:41 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] VM Stopped (Lifecycle Event)
Aug 17 08:29:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f2ed8ba6-d36b-4b0d-b344-d8058696c2a8 None None] [instance: 8067a647-dca0-47d4-a472-eac43a2e4de6] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updating instance_info_cache with network_info: [{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Releasing lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:29:41 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Creating image(s)
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG nova.objects.instance [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'trusted_certs' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-eba955a2-45f6-4a8c-befa-9c5e5cc838e6 req-710a63e0-3ab6-4a9b-839c-a4bea957c7f4 service nova] Acquired lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG nova.network.neutron [req-eba955a2-45f6-4a8c-befa-9c5e5cc838e6 req-710a63e0-3ab6-4a9b-839c-a4bea957c7f4 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Refreshing network info cache for port 5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "2284aee919501053959fbe440ff4b8c7ae11eb6b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "2284aee919501053959fbe440ff4b8c7ae11eb6b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b.part --force-share --output=json" returned: 0 in 0.233s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:43 user nova-compute[72998]: DEBUG nova.virt.images [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] 813a2588-16f4-4269-b238-82a0cfe124d9 was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:29:43 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:29:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b.part /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-eba955a2-45f6-4a8c-befa-9c5e5cc838e6 req-710a63e0-3ab6-4a9b-839c-a4bea957c7f4 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updated VIF entry in instance network info cache for port 5160fa81-e465-4cf0-b0a0-862256c60f8b. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:29:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-eba955a2-45f6-4a8c-befa-9c5e5cc838e6 req-710a63e0-3ab6-4a9b-839c-a4bea957c7f4 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updating instance_info_cache with network_info: [{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:29:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-eba955a2-45f6-4a8c-befa-9c5e5cc838e6 req-710a63e0-3ab6-4a9b-839c-a4bea957c7f4 service nova] Releasing lock "refresh_cache-382786b5-2479-4260-8be7-e56513d85fb3" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:29:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b.part /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b.converted" returned: 0 in 0.588s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "2284aee919501053959fbe440ff4b8c7ae11eb6b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.063s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "2284aee919501053959fbe440ff4b8c7ae11eb6b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "2284aee919501053959fbe440ff4b8c7ae11eb6b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b,backing_fmt=raw /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b,backing_fmt=raw /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk 1073741824" returned: 0 in 0.055s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "2284aee919501053959fbe440ff4b8c7ae11eb6b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b --force-share --output=json" returned: 0 in 0.169s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG nova.objects.instance [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'migration_context' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:44 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Rebasing disk image.
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.211s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 -F raw /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 -F raw /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk" returned: 0 in 2.351s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Ensure instance console log exists: /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Start _get_guest_xml network_info=[{"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7e66061f118cb27a47081b8860b5495b',container_format='bare',created_at=2023-08-17T08:27:48Z,direct_url=<?>,disk_format='qcow2',id=813a2588-16f4-4269-b238-82a0cfe124d9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2116780994-shelved',owner='846580b37b3545319d1897e07c828c59',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-17T08:27:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:29:47 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:29:47 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7e66061f118cb27a47081b8860b5495b',container_format='bare',created_at=2023-08-17T08:27:48Z,direct_url=<?>,disk_format='qcow2',id=813a2588-16f4-4269-b238-82a0cfe124d9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2116780994-shelved',owner='846580b37b3545319d1897e07c828c59',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-17T08:27:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'vcpu_model' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2116780994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2116780994',id=26,image_ref='813a2588-16f4-4269-b238-82a0cfe124d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1914279933',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:25:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-zjvfbzbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member',shelved_at='2023-08-17T08:27:52.286962',shelved_host='user',shelved_image_id='813a2588-16f4-4269-b238-82a0cfe124d9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=382786b5-2479-4260-8be7-e56513d85fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'pci_devices' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:29:47 user nova-compute[72998]:   <uuid>382786b5-2479-4260-8be7-e56513d85fb3</uuid>
Aug 17 08:29:47 user nova-compute[72998]:   <name>instance-0000001a</name>
Aug 17 08:29:47 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:29:47 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:29:47 user nova-compute[72998]:   <metadata>
Aug 17 08:29:47 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:29:47 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:29:47 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2116780994</nova:name>
Aug 17 08:29:47 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:29:47</nova:creationTime>
Aug 17 08:29:47 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:29:47 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:29:47 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:29:47 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:29:47 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:29:47 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:29:47 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:29:47 user nova-compute[72998]:       <nova:owner>
Aug 17 08:29:47 user nova-compute[72998]:         <nova:user uuid="cf8febbec4ce4eb9a0132c51fae76de1">tempest-AttachVolumeShelveTestJSON-257833239-project-member</nova:user>
Aug 17 08:29:47 user nova-compute[72998]:         <nova:project uuid="846580b37b3545319d1897e07c828c59">tempest-AttachVolumeShelveTestJSON-257833239</nova:project>
Aug 17 08:29:47 user nova-compute[72998]:       </nova:owner>
Aug 17 08:29:47 user nova-compute[72998]:       <nova:root type="image" uuid="813a2588-16f4-4269-b238-82a0cfe124d9"/>
Aug 17 08:29:47 user nova-compute[72998]:       <nova:ports>
Aug 17 08:29:47 user nova-compute[72998]:         <nova:port uuid="5160fa81-e465-4cf0-b0a0-862256c60f8b">
Aug 17 08:29:47 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 08:29:47 user nova-compute[72998]:         </nova:port>
Aug 17 08:29:47 user nova-compute[72998]:       </nova:ports>
Aug 17 08:29:47 user nova-compute[72998]:     </nova:instance>
Aug 17 08:29:47 user nova-compute[72998]:   </metadata>
Aug 17 08:29:47 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:29:47 user nova-compute[72998]:     <system>
Aug 17 08:29:47 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:29:47 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:29:47 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:29:47 user nova-compute[72998]:       <entry name="serial">382786b5-2479-4260-8be7-e56513d85fb3</entry>
Aug 17 08:29:47 user nova-compute[72998]:       <entry name="uuid">382786b5-2479-4260-8be7-e56513d85fb3</entry>
Aug 17 08:29:47 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:29:47 user nova-compute[72998]:     </system>
Aug 17 08:29:47 user nova-compute[72998]:   </sysinfo>
Aug 17 08:29:47 user nova-compute[72998]:   <os>
Aug 17 08:29:47 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:29:47 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:29:47 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:29:47 user nova-compute[72998]:   </os>
Aug 17 08:29:47 user nova-compute[72998]:   <features>
Aug 17 08:29:47 user nova-compute[72998]:     <acpi/>
Aug 17 08:29:47 user nova-compute[72998]:     <apic/>
Aug 17 08:29:47 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:29:47 user nova-compute[72998]:   </features>
Aug 17 08:29:47 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:29:47 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:29:47 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:29:47 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:29:47 user nova-compute[72998]:   </clock>
Aug 17 08:29:47 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:29:47 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:29:47 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:29:47 user nova-compute[72998]:   </cpu>
Aug 17 08:29:47 user nova-compute[72998]:   <devices>
Aug 17 08:29:47 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:29:47 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:29:47 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk"/>
Aug 17 08:29:47 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:29:47 user nova-compute[72998]:     </disk>
Aug 17 08:29:47 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:29:47 user nova-compute[72998]:       <mac address="fa:16:3e:51:39:e0"/>
Aug 17 08:29:47 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:29:47 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:29:47 user nova-compute[72998]:       <target dev="tap5160fa81-e4"/>
Aug 17 08:29:47 user nova-compute[72998]:     </interface>
Aug 17 08:29:47 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:29:47 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/console.log" append="off"/>
Aug 17 08:29:47 user nova-compute[72998]:     </serial>
Aug 17 08:29:47 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:29:47 user nova-compute[72998]:     <video>
Aug 17 08:29:47 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:29:47 user nova-compute[72998]:     </video>
Aug 17 08:29:47 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:29:47 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:29:47 user nova-compute[72998]:     </rng>
Aug 17 08:29:47 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:29:47 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:29:47 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:29:47 user nova-compute[72998]:     </memballoon>
Aug 17 08:29:47 user nova-compute[72998]:   </devices>
Aug 17 08:29:47 user nova-compute[72998]: </domain>
Aug 17 08:29:47 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2116780994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2116780994',id=26,image_ref='813a2588-16f4-4269-b238-82a0cfe124d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1914279933',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:25:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-zjvfbzbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member',shelved_at='2023-08-17T08:27:52.286962',shelved_host='user',shelved_image_id='813a2588-16f4-4269-b238-82a0cfe124d9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=382786b5-2479-4260-8be7-e56513d85fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG os_vif [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5160fa81-e4, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5160fa81-e4, col_values=(('external_ids', {'iface-id': '5160fa81-e465-4cf0-b0a0-862256c60f8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:39:e0', 'vm-uuid': '382786b5-2479-4260-8be7-e56513d85fb3'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:47 user nova-compute[72998]: INFO os_vif [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4')
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:29:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] No VIF found with MAC fa:16:3e:51:39:e0, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:29:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-cb4341e8-26b1-48b1-b131-8d6cc9bf62ab req-48f1559f-9f34-4ed0-9657-1e6eb918d9ac service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cb4341e8-26b1-48b1-b131-8d6cc9bf62ab req-48f1559f-9f34-4ed0-9657-1e6eb918d9ac service nova] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cb4341e8-26b1-48b1-b131-8d6cc9bf62ab req-48f1559f-9f34-4ed0-9657-1e6eb918d9ac service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cb4341e8-26b1-48b1-b131-8d6cc9bf62ab req-48f1559f-9f34-4ed0-9657-1e6eb918d9ac service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-cb4341e8-26b1-48b1-b131-8d6cc9bf62ab req-48f1559f-9f34-4ed0-9657-1e6eb918d9ac service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] No waiting events found dispatching network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:49 user nova-compute[72998]: WARNING nova.compute.manager [req-cb4341e8-26b1-48b1-b131-8d6cc9bf62ab req-48f1559f-9f34-4ed0-9657-1e6eb918d9ac service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received unexpected event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 08:29:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-50d1703c-0b87-4058-b6c0-7dae64de6e17 req-10ee0923-4a1e-43d3-bc3b-94468e68c819 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-50d1703c-0b87-4058-b6c0-7dae64de6e17 req-10ee0923-4a1e-43d3-bc3b-94468e68c819 service nova] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-50d1703c-0b87-4058-b6c0-7dae64de6e17 req-10ee0923-4a1e-43d3-bc3b-94468e68c819 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-50d1703c-0b87-4058-b6c0-7dae64de6e17 req-10ee0923-4a1e-43d3-bc3b-94468e68c819 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-50d1703c-0b87-4058-b6c0-7dae64de6e17 req-10ee0923-4a1e-43d3-bc3b-94468e68c819 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] No waiting events found dispatching network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:51 user nova-compute[72998]: WARNING nova.compute.manager [req-50d1703c-0b87-4058-b6c0-7dae64de6e17 req-10ee0923-4a1e-43d3-bc3b-94468e68c819 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received unexpected event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260991.3717291, 382786b5-2479-4260-8be7-e56513d85fb3 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:29:51 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] VM Resumed (Lifecycle Event)
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:29:51 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance spawned successfully.
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:29:51 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692260991.3742042, 382786b5-2479-4260-8be7-e56513d85fb3 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:29:51 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] VM Started (Lifecycle Event)
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:29:51 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:29:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:29:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-46d08f8e-d379-4fee-bb75-8021ddfaabe6 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.517s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Port e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 binding to destination host user is already ACTIVE {{(pid=72998) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquired lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Releasing lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Creating tmpfile /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/tmp_kptd95n to verify with other compute node that the instance is on the same shared storage. {{(pid=72998) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-4f6e0322-6bfe-450c-b8ae-e80ef103e528 req-edc2c807-982b-4682-96f5-be1347686c79 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4f6e0322-6bfe-450c-b8ae-e80ef103e528 req-edc2c807-982b-4682-96f5-be1347686c79 service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4f6e0322-6bfe-450c-b8ae-e80ef103e528 req-edc2c807-982b-4682-96f5-be1347686c79 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4f6e0322-6bfe-450c-b8ae-e80ef103e528 req-edc2c807-982b-4682-96f5-be1347686c79 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-4f6e0322-6bfe-450c-b8ae-e80ef103e528 req-edc2c807-982b-4682-96f5-be1347686c79 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:29:58 user nova-compute[72998]: WARNING nova.compute.manager [req-4f6e0322-6bfe-450c-b8ae-e80ef103e528 req-edc2c807-982b-4682-96f5-be1347686c79 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state resized and task_state resize_reverting.
Aug 17 08:29:58 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance destroyed successfully.
Aug 17 08:29:58 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'resources' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1893379751',display_name='tempest-ServerActionsTestOtherB-server-1893379751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1893379751',id=21,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1sywPS7noB6enRkafRCV4V8gUajrQp1IvyFeTNyX5oNNHzp72oZWl7JWE9EVMF5YzyYJVOw45540lSzJ/aE8AmU535jNS6dcszNW9Kp6/r+UbKETYBcWkdMqhnsqo26g==',key_name='tempest-keypair-2137913041',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90f94111e9fa4659a975f8478d7ca7da',ramdisk_id='',reservation_id='r-t6pdxe0v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1997511094',owner_user_name='tempest-ServerActionsTestOtherB-1997511094-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cbf4e4b883f484980af4bde95f8fd88',uuid=4119f28a-b9f1-4996-a144-68edd4f08c44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converting VIF {"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_vif [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9cd3f5a-80, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:29:58 user nova-compute[72998]: INFO os_vif [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80')
Aug 17 08:29:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:29:58 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4611b9-ed71-4c3f-a093-171ed6de2474]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[236a04d3-55a8-49db-8fbf-d286b9f56ca3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:29:58 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:29:58 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:29:58 user nova-compute[72998]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:29:58 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:29:58 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:29:58 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:29:58 user nova-compute[72998]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:29:58 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4ac5db6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad3664c-e48f-4cc0-8671-b613a2df4b20]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ee1995-7e8c-4032-9259-f1940c88921f]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd73e70-48d5-4e66-9f79-99978bdcb425]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ac481-7fe3-4463-b5a4-65a25bbee957]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[095e5fd5-1c82-4720-b583-4122fc56d0d8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[46435b7a-4769-4bf3-8ff9-d3c0617d8c0f]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]
Aug 17 08:29:58 user nova-compute[72998]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.
Aug 17 08:29:58 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c51fe0-e858-4a0c-b236-c463390e03af]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] <== disconnect_volume: return (295ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:29:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:29:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:29:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:29:59 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'migration_context' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-1d3c1107-c468-4485-8291-97d9a56b0757 req-cac79912-3692-46f6-bcdf-b94d526a1961 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1d3c1107-c468-4485-8291-97d9a56b0757 req-cac79912-3692-46f6-bcdf-b94d526a1961 service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1d3c1107-c468-4485-8291-97d9a56b0757 req-cac79912-3692-46f6-bcdf-b94d526a1961 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1d3c1107-c468-4485-8291-97d9a56b0757 req-cac79912-3692-46f6-bcdf-b94d526a1961 service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-1d3c1107-c468-4485-8291-97d9a56b0757 req-cac79912-3692-46f6-bcdf-b94d526a1961 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:30:00 user nova-compute[72998]: WARNING nova.compute.manager [req-1d3c1107-c468-4485-8291-97d9a56b0757 req-cac79912-3692-46f6-bcdf-b94d526a1961 service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state resized and task_state resize_reverting.
Aug 17 08:30:00 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.421s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:00 user nova-compute[72998]: INFO nova.compute.manager [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Swapping old allocation on dict_keys(['fab9829a-6c05-4a2c-bb1e-0919bb928c91']) held by migration f644891c-580d-4d34-a732-356f754a6ab5 for instance
Aug 17 08:30:00 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Overwriting current allocation {'allocations': {'fab9829a-6c05-4a2c-bb1e-0919bb928c91': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 38}}, 'project_id': '90f94111e9fa4659a975f8478d7ca7da', 'user_id': '9cbf4e4b883f484980af4bde95f8fd88', 'consumer_generation': 1} on consumer 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquired lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Releasing lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG os_brick.utils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:30:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1370b419-ff93-48e0-8aff-8743b34ed731]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab7a661-9471-4845-b60a-68b7a2847129]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade7f1f-5f57-4efc-8663-d920c203d73d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dece146-461c-4d63-bce8-1f1d3cef3577]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:30:01 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:30:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2a8a3a-b53b-4302-8958-64fd976ba47d]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:30:01 user nova-compute[72998]: DEBUG os_brick.utils [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:30:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:30:06 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:30:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:30:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-4119f28a-b9f1-4996-a144-68edd4f08c44" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:30:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:30:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:30:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:30:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:11 user nova-compute[72998]: INFO nova.compute.manager [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Detaching volume 4d238b32-97a2-429c-9d30-6ce0a87a2986
Aug 17 08:30:11 user nova-compute[72998]: INFO nova.virt.block_device [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Attempting to driver detach volume 4d238b32-97a2-429c-9d30-6ce0a87a2986 from mountpoint /dev/vdb
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Attempting to detach device vdb from instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:30:11 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:30:11 user nova-compute[72998]:   <source dev="/dev/sde"/>
Aug 17 08:30:11 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:30:11 user nova-compute[72998]:   <serial>4d238b32-97a2-429c-9d30-6ce0a87a2986</serial>
Aug 17 08:30:11 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 08:30:11 user nova-compute[72998]: </disk>
Aug 17 08:30:11 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:30:11 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully detached device vdb from instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f from the persistent domain config.
Aug 17 08:30:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:30:11 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:30:11 user nova-compute[72998]:   <source dev="/dev/sde"/>
Aug 17 08:30:11 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:30:11 user nova-compute[72998]:   <serial>4d238b32-97a2-429c-9d30-6ce0a87a2986</serial>
Aug 17 08:30:11 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 08:30:11 user nova-compute[72998]: </disk>
Aug 17 08:30:11 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692261012.135641, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:30:12 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully detached device vdb from instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f from the live domain config.
Aug 17 08:30:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnTEULqa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:30:12 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f422e1-77d4-42a5-a236-6be3417b473a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbfaf56-5654-41cb-abf3-99dd5df4a393]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:12 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:12 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:30:12 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:12 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:12 user nova-compute[72998]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 (non-flash)
Aug 17 08:30:12 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa48835bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986'): ({'sde'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Removing single pathed devices sde {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[822124f4-7a5b-47e1-8e38-805ffb480439]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[641dcf63-34a7-482d-8c6d-5640521df357]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flushing IO for device /dev/sde {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c180a7c5-c471-469b-84b2-bbe988b68148]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745d844-92ea-4d1f-a10b-d6119fdd225c]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a8f12f-2c03-4e33-a640-455bc5cfd5ad]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b661e3-4347-4a57-be72-78176082fad8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260]
Aug 17 08:30:12 user nova-compute[72998]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986, portal: 172.16.0.220,3260] successful.
Aug 17 08:30:12 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d238b32-97a2-429c-9d30-6ce0a87a2986 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb785d36-8075-4031-94ec-4e67a38b4da2]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== disconnect_volume: return (329ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692260998.4989285, 4119f28a-b9f1-4996-a144-68edd4f08c44 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:30:13 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] VM Stopped (Lifecycle Event)
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fbd1d5e5-0939-4a93-b25e-f9190bc4d8a9 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:30:14 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:30:14 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:30:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7501MB free_disk=23.99765396118164GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:30:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 603c6577-f34a-450d-a137-603469e19ede actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 14587314-30ee-4661-8800-bf1391b1500b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 382786b5-2479-4260-8be7-e56513d85fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Starting finish_revert_migration {{(pid=72998) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Start _get_guest_xml network_info=[{"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a46f1aac-92da-40da-80e1-738d21a49665', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4119f28a-b9f1-4996-a144-68edd4f08c44', 'attached_at': '2023-08-17T08:30:19.000000', 'detached_at': '', 'volume_id': '3c6d5e7f-f3b0-4c02-983b-4594be7d8551', 'serial': '3c6d5e7f-f3b0-4c02-983b-4594be7d8551'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:30:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:30:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:30:18 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:30:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:30:18 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:30:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:30:18 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d716848-9d39-48f0-bec5-1afb66ce8936]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:30:18 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b771d47b-afe3-428f-b9be-5d493ecce277]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551] added
Aug 17 08:30:18 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0de834e-7517-41d3-a3a2-0f9fe1cf786a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[78837f6e-3f63-45e2-95b3-ad1eb8c78088]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCyoBIwl {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d1c1f42d-c734-4f5b-b396-81fbcf054039 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.506s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCyoBIwl" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba79c86-2df9-4366-9f5e-cbce1418fe01]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JCyoBIwl'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[126e4559-5e3d-4945-b4f6-ecff3ff118f9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2711e8c-6e86-4b1c-83e1-f45a81222f68]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3c948b-ebbe-4733-bc8a-c33a4ca9ef70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]
Aug 17 08:30:19 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.
Aug 17 08:30:19 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[894661c1-b88a-40df-a590-7643ebcaeffc]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a33e0f-ea54-45ed-8ae7-ff4ded486c93]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:30:19 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d04bb-d562-48df-8008-5862f0aeec5f]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:30:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-406e3f27-eda9-4db9-a925-ab9e7ab19d82 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-406e3f27-eda9-4db9-a925-ab9e7ab19d82 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-406e3f27-eda9-4db9-a925-ab9e7ab19d82 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-406e3f27-eda9-4db9-a925-ab9e7ab19d82 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72998) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.objects.instance [None req-406e3f27-eda9-4db9-a925-ab9e7ab19d82 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26333346466303963', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333346466303963', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1893379751',display_name='tempest-ServerActionsTestOtherB-server-1893379751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1893379751',id=21,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1sywPS7noB6enRkafRCV4V8gUajrQp1IvyFeTNyX5oNNHzp72oZWl7JWE9EVMF5YzyYJVOw45540lSzJ/aE8AmU535jNS6dcszNW9Kp6/r+UbKETYBcWkdMqhnsqo26g==',key_name='tempest-keypair-2137913041',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='90f94111e9fa4659a975f8478d7ca7da',ramdisk_id='',reservation_id='r-t6pdxe0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1997511094',owner_user_name='tempest-ServerActionsTestOtherB-1997511094-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:29:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cbf4e4b883f484980af4bde95f8fd88',uuid=4119f28a-b9f1-4996-a144-68edd4f08c44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converting VIF {"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:30:20 user nova-compute[72998]:   <uuid>4119f28a-b9f1-4996-a144-68edd4f08c44</uuid>
Aug 17 08:30:20 user nova-compute[72998]:   <name>instance-00000015</name>
Aug 17 08:30:20 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:30:20 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:30:20 user nova-compute[72998]:   <metadata>
Aug 17 08:30:20 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:30:20 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:30:20 user nova-compute[72998]:       <nova:name>tempest-ServerActionsTestOtherB-server-1893379751</nova:name>
Aug 17 08:30:20 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:30:18</nova:creationTime>
Aug 17 08:30:20 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:30:20 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:30:20 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:30:20 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:30:20 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:30:20 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:30:20 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:30:20 user nova-compute[72998]:       <nova:owner>
Aug 17 08:30:20 user nova-compute[72998]:         <nova:user uuid="9cbf4e4b883f484980af4bde95f8fd88">tempest-ServerActionsTestOtherB-1997511094-project-member</nova:user>
Aug 17 08:30:20 user nova-compute[72998]:         <nova:project uuid="90f94111e9fa4659a975f8478d7ca7da">tempest-ServerActionsTestOtherB-1997511094</nova:project>
Aug 17 08:30:20 user nova-compute[72998]:       </nova:owner>
Aug 17 08:30:20 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:30:20 user nova-compute[72998]:       <nova:ports>
Aug 17 08:30:20 user nova-compute[72998]:         <nova:port uuid="e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3">
Aug 17 08:30:20 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 08:30:20 user nova-compute[72998]:         </nova:port>
Aug 17 08:30:20 user nova-compute[72998]:       </nova:ports>
Aug 17 08:30:20 user nova-compute[72998]:     </nova:instance>
Aug 17 08:30:20 user nova-compute[72998]:   </metadata>
Aug 17 08:30:20 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:30:20 user nova-compute[72998]:     <system>
Aug 17 08:30:20 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:30:20 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:30:20 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:30:20 user nova-compute[72998]:       <entry name="serial">4119f28a-b9f1-4996-a144-68edd4f08c44</entry>
Aug 17 08:30:20 user nova-compute[72998]:       <entry name="uuid">4119f28a-b9f1-4996-a144-68edd4f08c44</entry>
Aug 17 08:30:20 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:30:20 user nova-compute[72998]:     </system>
Aug 17 08:30:20 user nova-compute[72998]:   </sysinfo>
Aug 17 08:30:20 user nova-compute[72998]:   <os>
Aug 17 08:30:20 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:30:20 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:30:20 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:30:20 user nova-compute[72998]:   </os>
Aug 17 08:30:20 user nova-compute[72998]:   <features>
Aug 17 08:30:20 user nova-compute[72998]:     <acpi/>
Aug 17 08:30:20 user nova-compute[72998]:     <apic/>
Aug 17 08:30:20 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:30:20 user nova-compute[72998]:   </features>
Aug 17 08:30:20 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:30:20 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:30:20 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:30:20 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:30:20 user nova-compute[72998]:   </clock>
Aug 17 08:30:20 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:30:20 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:30:20 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:30:20 user nova-compute[72998]:   </cpu>
Aug 17 08:30:20 user nova-compute[72998]:   <devices>
Aug 17 08:30:20 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:30:20 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:30:20 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk"/>
Aug 17 08:30:20 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:30:20 user nova-compute[72998]:     </disk>
Aug 17 08:30:20 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:30:20 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:30:20 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 08:30:20 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:30:20 user nova-compute[72998]:       <serial>3c6d5e7f-f3b0-4c02-983b-4594be7d8551</serial>
Aug 17 08:30:20 user nova-compute[72998]:     </disk>
Aug 17 08:30:20 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:30:20 user nova-compute[72998]:       <mac address="fa:16:3e:36:9d:90"/>
Aug 17 08:30:20 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:30:20 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:30:20 user nova-compute[72998]:       <target dev="tape9cd3f5a-80"/>
Aug 17 08:30:20 user nova-compute[72998]:     </interface>
Aug 17 08:30:20 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:30:20 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/console.log" append="off"/>
Aug 17 08:30:20 user nova-compute[72998]:     </serial>
Aug 17 08:30:20 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:30:20 user nova-compute[72998]:     <video>
Aug 17 08:30:20 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:30:20 user nova-compute[72998]:     </video>
Aug 17 08:30:20 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:30:20 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:30:20 user nova-compute[72998]:     </rng>
Aug 17 08:30:20 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:30:20 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:30:20 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:30:20 user nova-compute[72998]:     </memballoon>
Aug 17 08:30:20 user nova-compute[72998]:   </devices>
Aug 17 08:30:20 user nova-compute[72998]: </domain>
Aug 17 08:30:20 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1893379751',display_name='tempest-ServerActionsTestOtherB-server-1893379751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1893379751',id=21,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1sywPS7noB6enRkafRCV4V8gUajrQp1IvyFeTNyX5oNNHzp72oZWl7JWE9EVMF5YzyYJVOw45540lSzJ/aE8AmU535jNS6dcszNW9Kp6/r+UbKETYBcWkdMqhnsqo26g==',key_name='tempest-keypair-2137913041',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='90f94111e9fa4659a975f8478d7ca7da',ramdisk_id='',reservation_id='r-t6pdxe0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1997511094',owner_user_name='tempest-ServerActionsTestOtherB-1997511094-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:29:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cbf4e4b883f484980af4bde95f8fd88',uuid=4119f28a-b9f1-4996-a144-68edd4f08c44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converting VIF {"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG os_vif [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9cd3f5a-80, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9cd3f5a-80, col_values=(('external_ids', {'iface-id': 'e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:9d:90', 'vm-uuid': '4119f28a-b9f1-4996-a144-68edd4f08c44'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:20 user nova-compute[72998]: INFO os_vif [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80')
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-bb3e6910-7575-4314-8a24-bb64db7ed636 req-cae2f99c-1ae0-4e4a-a6f0-b30701ac21ec service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-unplugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bb3e6910-7575-4314-8a24-bb64db7ed636 req-cae2f99c-1ae0-4e4a-a6f0-b30701ac21ec service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bb3e6910-7575-4314-8a24-bb64db7ed636 req-cae2f99c-1ae0-4e4a-a6f0-b30701ac21ec service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bb3e6910-7575-4314-8a24-bb64db7ed636 req-cae2f99c-1ae0-4e4a-a6f0-b30701ac21ec service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-bb3e6910-7575-4314-8a24-bb64db7ed636 req-cae2f99c-1ae0-4e4a-a6f0-b30701ac21ec service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-unplugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:30:20 user nova-compute[72998]: WARNING nova.compute.manager [req-bb3e6910-7575-4314-8a24-bb64db7ed636 req-cae2f99c-1ae0-4e4a-a6f0-b30701ac21ec service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-unplugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state active and task_state powering-off.
Aug 17 08:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:21 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance destroyed successfully.
Aug 17 08:30:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-406e3f27-eda9-4db9-a925-ab9e7ab19d82 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:30:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-406e3f27-eda9-4db9-a925-ab9e7ab19d82 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.205s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:30:22 user nova-compute[72998]: WARNING nova.compute.manager [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state stopped and task_state None.
Aug 17 08:30:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:30:22 user nova-compute[72998]: WARNING nova.compute.manager [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state resized and task_state resize_reverting.
Aug 17 08:30:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:30:22 user nova-compute[72998]: WARNING nova.compute.manager [req-721ea3b1-2c0b-439c-8aaf-f9161b585226 req-f5c094b8-7553-416c-8c9a-ebe81f8602ba service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state resized and task_state resize_reverting.
Aug 17 08:30:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:24 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261024.3086894, 4119f28a-b9f1-4996-a144-68edd4f08c44 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:30:24 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] VM Resumed (Lifecycle Event)
Aug 17 08:30:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:30:24 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance running successfully.
Aug 17 08:30:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] finish_revert_migration finished successfully. {{(pid=72998) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 17 08:30:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:30:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:30:24 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 08:30:24 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261024.311842, 4119f28a-b9f1-4996-a144-68edd4f08c44 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:30:24 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] VM Started (Lifecycle Event)
Aug 17 08:30:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:30:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:30:24 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 08:30:24 user nova-compute[72998]: INFO nova.compute.manager [None req-7489c0c6-9773-449d-abe2-ef0acf9e5509 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance to original state: 'active'
Aug 17 08:30:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:31 user nova-compute[72998]: INFO nova.compute.manager [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Terminating instance
Aug 17 08:30:31 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-22676e6b-354a-4185-a243-d1eb0eb59d8b req-a16e4638-52ad-45ac-95cc-5efbc3bc8161 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-unplugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-22676e6b-354a-4185-a243-d1eb0eb59d8b req-a16e4638-52ad-45ac-95cc-5efbc3bc8161 service nova] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-22676e6b-354a-4185-a243-d1eb0eb59d8b req-a16e4638-52ad-45ac-95cc-5efbc3bc8161 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-22676e6b-354a-4185-a243-d1eb0eb59d8b req-a16e4638-52ad-45ac-95cc-5efbc3bc8161 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-22676e6b-354a-4185-a243-d1eb0eb59d8b req-a16e4638-52ad-45ac-95cc-5efbc3bc8161 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] No waiting events found dispatching network-vif-unplugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-22676e6b-354a-4185-a243-d1eb0eb59d8b req-a16e4638-52ad-45ac-95cc-5efbc3bc8161 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-unplugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:30:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Instance destroyed successfully.
Aug 17 08:30:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'resources' on Instance uuid 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2108467117',display_name='tempest-ServerRescueNegativeTestJSON-server-2108467117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2108467117',id=4,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:16:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-zpdtk9hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:16:05Z,user_data=None,user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=7b895ebd-5c4d-4350-9cbc-39e427e0cb05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "address": "fa:16:3e:7f:c7:ba", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8370d19-8e", "ovs_interfaceid": "a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:ba,bridge_name='br-int',has_traffic_filtering=True,id=a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8370d19-8e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG os_vif [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:ba,bridge_name='br-int',has_traffic_filtering=True,id=a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8370d19-8e') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8370d19-8e, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:30:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:31 user nova-compute[72998]: INFO os_vif [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:ba,bridge_name='br-int',has_traffic_filtering=True,id=a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8370d19-8e')
Aug 17 08:30:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Deleting instance files /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05_del
Aug 17 08:30:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Deletion of /opt/stack/data/nova/instances/7b895ebd-5c4d-4350-9cbc-39e427e0cb05_del complete
Aug 17 08:30:32 user nova-compute[72998]: INFO nova.compute.manager [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 08:30:32 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:30:32 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:30:32 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:30:32 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:30:32 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Took 0.42 seconds to deallocate network for instance.
Aug 17 08:30:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:33 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:30:33 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:30:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:33 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Deleted allocations for instance 7b895ebd-5c4d-4350-9cbc-39e427e0cb05
Aug 17 08:30:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dd9d21ea-a26d-4ace-9002-473f0e9ecd51 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.093s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-e6427f8e-b524-4d49-9cf7-8f9d6ff6f221 req-146ccafa-ed0d-4581-a324-2e606f793d78 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:30:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e6427f8e-b524-4d49-9cf7-8f9d6ff6f221 req-146ccafa-ed0d-4581-a324-2e606f793d78 service nova] Acquiring lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e6427f8e-b524-4d49-9cf7-8f9d6ff6f221 req-146ccafa-ed0d-4581-a324-2e606f793d78 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e6427f8e-b524-4d49-9cf7-8f9d6ff6f221 req-146ccafa-ed0d-4581-a324-2e606f793d78 service nova] Lock "7b895ebd-5c4d-4350-9cbc-39e427e0cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-e6427f8e-b524-4d49-9cf7-8f9d6ff6f221 req-146ccafa-ed0d-4581-a324-2e606f793d78 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] No waiting events found dispatching network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:30:33 user nova-compute[72998]: WARNING nova.compute.manager [req-e6427f8e-b524-4d49-9cf7-8f9d6ff6f221 req-146ccafa-ed0d-4581-a324-2e606f793d78 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received unexpected event network-vif-plugged-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 for instance with vm_state deleted and task_state None.
Aug 17 08:30:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-e6427f8e-b524-4d49-9cf7-8f9d6ff6f221 req-146ccafa-ed0d-4581-a324-2e606f793d78 service nova] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Received event network-vif-deleted-a8370d19-8e8e-4eed-ae46-fc3c48ee2ab3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:30:36 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261021.3652377, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:30:36 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] VM Stopped (Lifecycle Event)
Aug 17 08:30:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fe83d56c-cb36-47f6-b99e-9689bc5c34ab None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:30:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fe83d56c-cb36-47f6-b99e-9689bc5c34ab None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:30:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-6862a6ac-9e8b-40cd-92fb-244068ba8a02 req-82e3fd2b-6458-4aad-9ab7-14e063457105 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received event network-changed-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-6862a6ac-9e8b-40cd-92fb-244068ba8a02 req-82e3fd2b-6458-4aad-9ab7-14e063457105 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Refreshing instance network info cache due to event network-changed-aedfec88-8b06-4f74-a916-2d99204d272e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6862a6ac-9e8b-40cd-92fb-244068ba8a02 req-82e3fd2b-6458-4aad-9ab7-14e063457105 service nova] Acquiring lock "refresh_cache-cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6862a6ac-9e8b-40cd-92fb-244068ba8a02 req-82e3fd2b-6458-4aad-9ab7-14e063457105 service nova] Acquired lock "refresh_cache-cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-6862a6ac-9e8b-40cd-92fb-244068ba8a02 req-82e3fd2b-6458-4aad-9ab7-14e063457105 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Refreshing network info cache for port aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'flavor' on Instance uuid cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:30:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Ignoring supplied device name: /dev/vdb
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:39 user nova-compute[72998]: INFO nova.compute.manager [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Attaching volume 05fd941a-05d8-4754-bda6-e370cbfddbd2 to /dev/vdb
Aug 17 08:30:39 user nova-compute[72998]: DEBUG os_brick.utils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[383c1db3-6280-483c-8140-f92d118e6369]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-6862a6ac-9e8b-40cd-92fb-244068ba8a02 req-82e3fd2b-6458-4aad-9ab7-14e063457105 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Updated VIF entry in instance network info cache for port aedfec88-8b06-4f74-a916-2d99204d272e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-6862a6ac-9e8b-40cd-92fb-244068ba8a02 req-82e3fd2b-6458-4aad-9ab7-14e063457105 service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Updating instance_info_cache with network_info: [{"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a5cbaf-1a37-4ba3-82e6-0af6e70edc63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6862a6ac-9e8b-40cd-92fb-244068ba8a02 req-82e3fd2b-6458-4aad-9ab7-14e063457105 service nova] Releasing lock "refresh_cache-cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5153a671-af32-4206-9997-55c3afa70e65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d924c3-afef-4938-b9e5-5f4b92354cc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:30:39 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:30:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b86446-ec42-441e-9147-ef0f2661a544]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG os_brick.utils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:30:39 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Updating existing volume attachment record: cf1abdf9-40e9-4ad3-897e-1c5f61d0c85f {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:30:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:46 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261031.893024, 7b895ebd-5c4d-4350-9cbc-39e427e0cb05 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:30:46 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] VM Stopped (Lifecycle Event)
Aug 17 08:30:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d7151253-e39b-4d4a-8db8-0df634c56155 None None] [instance: 7b895ebd-5c4d-4350-9cbc-39e427e0cb05] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:30:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTQXmYWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:30:50 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:30:50 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:30:50 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee5e687-e9f6-4b18-bbdf-678006ec7fb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:30:50 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bf9832-41df-484a-84e4-70d6661efe9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2] added
Aug 17 08:30:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a40459-1e09-42b7-8440-3a07a7a35110]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef43ee4-69be-47de-a3d1-b61a06b3f7db]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTQXmYWg {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTQXmYWg" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f55438-9a1b-4d11-9e10-7d313c50b093]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTQXmYWg'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e6547c-a204-400a-8597-c5311641b126]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc476af1-0f2f-4540-997e-4bd11078dd9d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[264b9898-ca06-46ea-867f-6c18657b2de2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2, portal: 172.16.0.220,3260]
Aug 17 08:30:50 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2, portal: 172.16.0.220,3260] successful.
Aug 17 08:30:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a8173d-5f4f-4349-9148-2be1bde9ee16]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa038ad-6dca-45d7-88a4-4c5d38284cad]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 (non-flash)
Aug 17 08:30:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd82ced-9a9b-4429-ac3c-72352b3bcb61]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:30:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTQXmYWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23764666235333938', 'path': '/dev/sde'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764666235333938', 'path': '/dev/sde'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'flavor' on Instance uuid cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:30:51 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:30:51 user nova-compute[72998]:   <source dev="/dev/sde"/>
Aug 17 08:30:51 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:30:51 user nova-compute[72998]:   <serial>05fd941a-05d8-4754-bda6-e370cbfddbd2</serial>
Aug 17 08:30:51 user nova-compute[72998]: </disk>
Aug 17 08:30:51 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] No VIF found with MAC fa:16:3e:fe:cb:13, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b786b880-6aa6-4f53-95e7-0c307a76fe55 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.444s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid e2b811f8-19a3-4b50-8ea9-6d3442c38819 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 603c6577-f34a-450d-a137-603469e19ede {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 14587314-30ee-4661-8800-bf1391b1500b {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "603c6577-f34a-450d-a137-603469e19ede" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "382786b5-2479-4260-8be7-e56513d85fb3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "14587314-30ee-4661-8800-bf1391b1500b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "14587314-30ee-4661-8800-bf1391b1500b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "603c6577-f34a-450d-a137-603469e19ede" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "382786b5-2479-4260-8be7-e56513d85fb3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "14587314-30ee-4661-8800-bf1391b1500b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:30:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:30:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:31:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:31:00 user nova-compute[72998]: INFO nova.compute.claims [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Claim successful on node user
Aug 17 08:31:01 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:31:01 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:31:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG nova.policy [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf94d9d63f9e4e5a9d0a4f175fddff16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef0a0f5a7b6484483231263041317df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:31:01 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Creating image(s)
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "/opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "/opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk 1073741824" returned: 0 in 0.049s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.235s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Successfully created port: 6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Cannot resize image /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'migration_context' on Instance uuid ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Ensure instance console log exists: /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Successfully updated port: 6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "refresh_cache-ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquired lock "refresh_cache-ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-53fbe993-35f5-4628-bf1f-3fd8809fb36a req-4dc37b09-f9b7-496a-9739-b02ade5e8a72 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received event network-changed-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-53fbe993-35f5-4628-bf1f-3fd8809fb36a req-4dc37b09-f9b7-496a-9739-b02ade5e8a72 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Refreshing instance network info cache due to event network-changed-6e4b7487-b3b6-476f-96b6-97afb7265763. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-53fbe993-35f5-4628-bf1f-3fd8809fb36a req-4dc37b09-f9b7-496a-9739-b02ade5e8a72 service nova] Acquiring lock "refresh_cache-ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:31:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Updating instance_info_cache with network_info: [{"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Releasing lock "refresh_cache-ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Instance network_info: |[{"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-53fbe993-35f5-4628-bf1f-3fd8809fb36a req-4dc37b09-f9b7-496a-9739-b02ade5e8a72 service nova] Acquired lock "refresh_cache-ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.network.neutron [req-53fbe993-35f5-4628-bf1f-3fd8809fb36a req-4dc37b09-f9b7-496a-9739-b02ade5e8a72 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Refreshing network info cache for port 6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Start _get_guest_xml network_info=[{"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:31:03 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:31:03 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-561767268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-561767268',id=30,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-vr4t4ei8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:31:01Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=6e4b7487-b3b6-476f-96b6-97afb7265763,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4b7487-b3') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'pci_devices' on Instance uuid ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:31:03 user nova-compute[72998]:   <uuid>ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4</uuid>
Aug 17 08:31:03 user nova-compute[72998]:   <name>instance-0000001e</name>
Aug 17 08:31:03 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:31:03 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:31:03 user nova-compute[72998]:   <metadata>
Aug 17 08:31:03 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:31:03 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:31:03 user nova-compute[72998]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-561767268</nova:name>
Aug 17 08:31:03 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:31:03</nova:creationTime>
Aug 17 08:31:03 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:31:03 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:31:03 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:31:03 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:31:03 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:31:03 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:31:03 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:31:03 user nova-compute[72998]:       <nova:owner>
Aug 17 08:31:03 user nova-compute[72998]:         <nova:user uuid="cf94d9d63f9e4e5a9d0a4f175fddff16">tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member</nova:user>
Aug 17 08:31:03 user nova-compute[72998]:         <nova:project uuid="0ef0a0f5a7b6484483231263041317df">tempest-ServerBootFromVolumeStableRescueTest-1298365870</nova:project>
Aug 17 08:31:03 user nova-compute[72998]:       </nova:owner>
Aug 17 08:31:03 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:31:03 user nova-compute[72998]:       <nova:ports>
Aug 17 08:31:03 user nova-compute[72998]:         <nova:port uuid="6e4b7487-b3b6-476f-96b6-97afb7265763">
Aug 17 08:31:03 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 08:31:03 user nova-compute[72998]:         </nova:port>
Aug 17 08:31:03 user nova-compute[72998]:       </nova:ports>
Aug 17 08:31:03 user nova-compute[72998]:     </nova:instance>
Aug 17 08:31:03 user nova-compute[72998]:   </metadata>
Aug 17 08:31:03 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:31:03 user nova-compute[72998]:     <system>
Aug 17 08:31:03 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:31:03 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:31:03 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:31:03 user nova-compute[72998]:       <entry name="serial">ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4</entry>
Aug 17 08:31:03 user nova-compute[72998]:       <entry name="uuid">ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4</entry>
Aug 17 08:31:03 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:31:03 user nova-compute[72998]:     </system>
Aug 17 08:31:03 user nova-compute[72998]:   </sysinfo>
Aug 17 08:31:03 user nova-compute[72998]:   <os>
Aug 17 08:31:03 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:31:03 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:31:03 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:31:03 user nova-compute[72998]:   </os>
Aug 17 08:31:03 user nova-compute[72998]:   <features>
Aug 17 08:31:03 user nova-compute[72998]:     <acpi/>
Aug 17 08:31:03 user nova-compute[72998]:     <apic/>
Aug 17 08:31:03 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:31:03 user nova-compute[72998]:   </features>
Aug 17 08:31:03 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:31:03 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:31:03 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:31:03 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:31:03 user nova-compute[72998]:   </clock>
Aug 17 08:31:03 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:31:03 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:31:03 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:31:03 user nova-compute[72998]:   </cpu>
Aug 17 08:31:03 user nova-compute[72998]:   <devices>
Aug 17 08:31:03 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:31:03 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:31:03 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk"/>
Aug 17 08:31:03 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:31:03 user nova-compute[72998]:     </disk>
Aug 17 08:31:03 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:31:03 user nova-compute[72998]:       <mac address="fa:16:3e:3b:80:6d"/>
Aug 17 08:31:03 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:31:03 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:31:03 user nova-compute[72998]:       <target dev="tap6e4b7487-b3"/>
Aug 17 08:31:03 user nova-compute[72998]:     </interface>
Aug 17 08:31:03 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:31:03 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/console.log" append="off"/>
Aug 17 08:31:03 user nova-compute[72998]:     </serial>
Aug 17 08:31:03 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:31:03 user nova-compute[72998]:     <video>
Aug 17 08:31:03 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:31:03 user nova-compute[72998]:     </video>
Aug 17 08:31:03 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:31:03 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:31:03 user nova-compute[72998]:     </rng>
Aug 17 08:31:03 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:31:03 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:31:03 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:31:03 user nova-compute[72998]:     </memballoon>
Aug 17 08:31:03 user nova-compute[72998]:   </devices>
Aug 17 08:31:03 user nova-compute[72998]: </domain>
Aug 17 08:31:03 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-561767268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-561767268',id=30,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-vr4t4ei8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:31:01Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=6e4b7487-b3b6-476f-96b6-97afb7265763,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4b7487-b3') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG os_vif [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=6e4b7487-b3b6-476f-96b6-97afb7265763,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4b7487-b3') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e4b7487-b3, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e4b7487-b3, col_values=(('external_ids', {'iface-id': '6e4b7487-b3b6-476f-96b6-97afb7265763', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:80:6d', 'vm-uuid': 'ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:03 user nova-compute[72998]: INFO os_vif [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=6e4b7487-b3b6-476f-96b6-97afb7265763,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4b7487-b3')
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No VIF found with MAC fa:16:3e:3b:80:6d, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.network.neutron [req-53fbe993-35f5-4628-bf1f-3fd8809fb36a req-4dc37b09-f9b7-496a-9739-b02ade5e8a72 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Updated VIF entry in instance network info cache for port 6e4b7487-b3b6-476f-96b6-97afb7265763. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG nova.network.neutron [req-53fbe993-35f5-4628-bf1f-3fd8809fb36a req-4dc37b09-f9b7-496a-9739-b02ade5e8a72 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Updating instance_info_cache with network_info: [{"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:31:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-53fbe993-35f5-4628-bf1f-3fd8809fb36a req-4dc37b09-f9b7-496a-9739-b02ade5e8a72 service nova] Releasing lock "refresh_cache-ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:31:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:05 user nova-compute[72998]: DEBUG nova.compute.manager [req-23893e65-96c1-4691-98ae-8cf7e1ed4103 req-c700c664-6837-4b81-a836-38b3eff8c281 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received event network-vif-plugged-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-23893e65-96c1-4691-98ae-8cf7e1ed4103 req-c700c664-6837-4b81-a836-38b3eff8c281 service nova] Acquiring lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-23893e65-96c1-4691-98ae-8cf7e1ed4103 req-c700c664-6837-4b81-a836-38b3eff8c281 service nova] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-23893e65-96c1-4691-98ae-8cf7e1ed4103 req-c700c664-6837-4b81-a836-38b3eff8c281 service nova] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:05 user nova-compute[72998]: DEBUG nova.compute.manager [req-23893e65-96c1-4691-98ae-8cf7e1ed4103 req-c700c664-6837-4b81-a836-38b3eff8c281 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] No waiting events found dispatching network-vif-plugged-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:05 user nova-compute[72998]: WARNING nova.compute.manager [req-23893e65-96c1-4691-98ae-8cf7e1ed4103 req-c700c664-6837-4b81-a836-38b3eff8c281 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received unexpected event network-vif-plugged-6e4b7487-b3b6-476f-96b6-97afb7265763 for instance with vm_state building and task_state spawning.
Aug 17 08:31:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261066.8982615, ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:31:06 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] VM Resumed (Lifecycle Event)
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:31:06 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Instance spawned successfully.
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:31:06 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261066.9012887, ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:31:06 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] VM Started (Lifecycle Event)
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:31:06 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:31:07 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:31:07 user nova-compute[72998]: DEBUG nova.compute.manager [req-fb34fb96-4f4f-4b67-b6eb-6f5d406cd4f5 req-306fc5d0-e317-4f9f-8ee7-ebdb1cea4b68 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received event network-vif-plugged-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fb34fb96-4f4f-4b67-b6eb-6f5d406cd4f5 req-306fc5d0-e317-4f9f-8ee7-ebdb1cea4b68 service nova] Acquiring lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fb34fb96-4f4f-4b67-b6eb-6f5d406cd4f5 req-306fc5d0-e317-4f9f-8ee7-ebdb1cea4b68 service nova] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fb34fb96-4f4f-4b67-b6eb-6f5d406cd4f5 req-306fc5d0-e317-4f9f-8ee7-ebdb1cea4b68 service nova] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG nova.compute.manager [req-fb34fb96-4f4f-4b67-b6eb-6f5d406cd4f5 req-306fc5d0-e317-4f9f-8ee7-ebdb1cea4b68 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] No waiting events found dispatching network-vif-plugged-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:07 user nova-compute[72998]: WARNING nova.compute.manager [req-fb34fb96-4f4f-4b67-b6eb-6f5d406cd4f5 req-306fc5d0-e317-4f9f-8ee7-ebdb1cea4b68 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received unexpected event network-vif-plugged-6e4b7487-b3b6-476f-96b6-97afb7265763 for instance with vm_state building and task_state spawning.
Aug 17 08:31:07 user nova-compute[72998]: INFO nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 17 08:31:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:31:07 user nova-compute[72998]: INFO nova.compute.manager [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Took 6.48 seconds to build instance.
Aug 17 08:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6df92d99-c6b6-47f1-a2e4-bb367c96f4c9 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.735s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "14587314-30ee-4661-8800-bf1391b1500b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "14587314-30ee-4661-8800-bf1391b1500b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "14587314-30ee-4661-8800-bf1391b1500b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:07 user nova-compute[72998]: INFO nova.compute.manager [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Terminating instance
Aug 17 08:31:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updating instance_info_cache with network_info: [{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-783bb127-a43a-4028-a75c-12e136603280 req-f2fdccf6-5b1f-4ac2-a3bd-e3de5e63b7d0 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received event network-vif-unplugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-783bb127-a43a-4028-a75c-12e136603280 req-f2fdccf6-5b1f-4ac2-a3bd-e3de5e63b7d0 service nova] Acquiring lock "14587314-30ee-4661-8800-bf1391b1500b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-783bb127-a43a-4028-a75c-12e136603280 req-f2fdccf6-5b1f-4ac2-a3bd-e3de5e63b7d0 service nova] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-783bb127-a43a-4028-a75c-12e136603280 req-f2fdccf6-5b1f-4ac2-a3bd-e3de5e63b7d0 service nova] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-783bb127-a43a-4028-a75c-12e136603280 req-f2fdccf6-5b1f-4ac2-a3bd-e3de5e63b7d0 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] No waiting events found dispatching network-vif-unplugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-783bb127-a43a-4028-a75c-12e136603280 req-f2fdccf6-5b1f-4ac2-a3bd-e3de5e63b7d0 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received event network-vif-unplugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:31:08 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Instance destroyed successfully.
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.objects.instance [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lazy-loading 'resources' on Instance uuid 14587314-30ee-4661-8800-bf1391b1500b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1584276427',display_name='tempest-VolumesActionsTest-instance-1584276427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1584276427',id=29,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:29:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='310f3d4efad24fe59257fdc9be8723d7',ramdisk_id='',reservation_id='r-0356to74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-188754561',owner_user_name='tempest-VolumesActionsTest-188754561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:29:23Z,user_data=None,user_id='d1165511c08f4cb08358007fed3c2e5b',uuid=14587314-30ee-4661-8800-bf1391b1500b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converting VIF {"id": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "address": "fa:16:3e:56:91:b2", "network": {"id": "ae08cb6c-4f96-46ff-8ea7-2625520f2470", "bridge": "br-int", "label": "tempest-VolumesActionsTest-876820857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "310f3d4efad24fe59257fdc9be8723d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b94e17-17", "ovs_interfaceid": "d3b94e17-170c-4f51-a8b1-2f61b33a4bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:b2,bridge_name='br-int',has_traffic_filtering=True,id=d3b94e17-170c-4f51-a8b1-2f61b33a4bf8,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b94e17-17') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG os_vif [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:b2,bridge_name='br-int',has_traffic_filtering=True,id=d3b94e17-170c-4f51-a8b1-2f61b33a4bf8,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b94e17-17') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3b94e17-17, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:08 user nova-compute[72998]: INFO os_vif [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:91:b2,bridge_name='br-int',has_traffic_filtering=True,id=d3b94e17-170c-4f51-a8b1-2f61b33a4bf8,network=Network(ae08cb6c-4f96-46ff-8ea7-2625520f2470),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b94e17-17')
Aug 17 08:31:08 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Deleting instance files /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b_del
Aug 17 08:31:08 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Deletion of /opt/stack/data/nova/instances/14587314-30ee-4661-8800-bf1391b1500b_del complete
Aug 17 08:31:08 user nova-compute[72998]: INFO nova.compute.manager [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Took 0.79 seconds to destroy the instance on the hypervisor.
Aug 17 08:31:08 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 14587314-30ee-4661-8800-bf1391b1500b] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:31:08 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:31:09 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Took 0.54 seconds to deallocate network for instance.
Aug 17 08:31:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-205e916c-7eba-47b4-a25a-2595f7e80193 req-7d0e429d-9afb-429c-bd0f-3ac08dc1e112 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received event network-vif-deleted-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:09 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:31:09 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:31:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:09 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Deleted allocations for instance 14587314-30ee-4661-8800-bf1391b1500b
Aug 17 08:31:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da505a79-8d83-4c23-ba34-a69a65fb4d99 tempest-VolumesActionsTest-188754561 tempest-VolumesActionsTest-188754561-project-member] Lock "14587314-30ee-4661-8800-bf1391b1500b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.871s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-247f1e81-f77a-48de-b32d-2788102ffc87 req-8d75e26e-c3e6-417d-a7cf-cc64551e7141 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received event network-vif-plugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-247f1e81-f77a-48de-b32d-2788102ffc87 req-8d75e26e-c3e6-417d-a7cf-cc64551e7141 service nova] Acquiring lock "14587314-30ee-4661-8800-bf1391b1500b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-247f1e81-f77a-48de-b32d-2788102ffc87 req-8d75e26e-c3e6-417d-a7cf-cc64551e7141 service nova] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-247f1e81-f77a-48de-b32d-2788102ffc87 req-8d75e26e-c3e6-417d-a7cf-cc64551e7141 service nova] Lock "14587314-30ee-4661-8800-bf1391b1500b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-247f1e81-f77a-48de-b32d-2788102ffc87 req-8d75e26e-c3e6-417d-a7cf-cc64551e7141 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] No waiting events found dispatching network-vif-plugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:10 user nova-compute[72998]: WARNING nova.compute.manager [req-247f1e81-f77a-48de-b32d-2788102ffc87 req-8d75e26e-c3e6-417d-a7cf-cc64551e7141 service nova] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Received unexpected event network-vif-plugged-d3b94e17-170c-4f51-a8b1-2f61b33a4bf8 for instance with vm_state deleted and task_state None.
Aug 17 08:31:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:31:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:31:14 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:31:14 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7739MB free_disk=24.077987670898438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 0d992c9b-66c8-4bd9-b78e-51e13d662144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 603c6577-f34a-450d-a137-603469e19ede actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 382786b5-2479-4260-8be7-e56513d85fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:31:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:31:15 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:31:15 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:31:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:31:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:31:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:20 user nova-compute[72998]: INFO nova.compute.manager [None req-1a4c2b19-55bd-4302-8225-28f8092cb1be tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Get console output
Aug 17 08:31:20 user nova-compute[72998]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 17 08:31:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:21 user nova-compute[72998]: INFO nova.compute.manager [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Terminating instance
Aug 17 08:31:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-bbcea92d-d13c-4bd2-81fb-948358312e38 req-96125112-6b87-43f4-974e-965de42dff6a service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-unplugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bbcea92d-d13c-4bd2-81fb-948358312e38 req-96125112-6b87-43f4-974e-965de42dff6a service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bbcea92d-d13c-4bd2-81fb-948358312e38 req-96125112-6b87-43f4-974e-965de42dff6a service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-bbcea92d-d13c-4bd2-81fb-948358312e38 req-96125112-6b87-43f4-974e-965de42dff6a service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-bbcea92d-d13c-4bd2-81fb-948358312e38 req-96125112-6b87-43f4-974e-965de42dff6a service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-unplugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-bbcea92d-d13c-4bd2-81fb-948358312e38 req-96125112-6b87-43f4-974e-965de42dff6a service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-unplugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:31:22 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Instance destroyed successfully.
Aug 17 08:31:22 user nova-compute[72998]: DEBUG nova.objects.instance [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lazy-loading 'resources' on Instance uuid 0d992c9b-66c8-4bd9-b78e-51e13d662144 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1188743299',display_name='tempest-ServerRescueNegativeTestJSON-server-1188743299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1188743299',id=2,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:19:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8eaaef9c2492458bbe646bd227b11b64',ramdisk_id='',reservation_id='r-ixwnw5mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-826615417',owner_user_name='tempest-ServerRescueNegativeTestJSON-826615417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:20:52Z,user_data=None,user_id='4cf59502a7ee46968534c860fc9f49f5',uuid=0d992c9b-66c8-4bd9-b78e-51e13d662144,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converting VIF {"id": "75d77dae-ff35-4dee-a471-39e1476dd39e", "address": "fa:16:3e:55:53:e1", "network": {"id": "d9b8195c-ff5b-4415-8a08-d97517fb90ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-231729018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8eaaef9c2492458bbe646bd227b11b64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d77dae-ff", "ovs_interfaceid": "75d77dae-ff35-4dee-a471-39e1476dd39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:53:e1,bridge_name='br-int',has_traffic_filtering=True,id=75d77dae-ff35-4dee-a471-39e1476dd39e,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d77dae-ff') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG os_vif [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:53:e1,bridge_name='br-int',has_traffic_filtering=True,id=75d77dae-ff35-4dee-a471-39e1476dd39e,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d77dae-ff') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75d77dae-ff, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:22 user nova-compute[72998]: INFO os_vif [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:53:e1,bridge_name='br-int',has_traffic_filtering=True,id=75d77dae-ff35-4dee-a471-39e1476dd39e,network=Network(d9b8195c-ff5b-4415-8a08-d97517fb90ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d77dae-ff')
Aug 17 08:31:22 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Deleting instance files /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144_del
Aug 17 08:31:22 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Deletion of /opt/stack/data/nova/instances/0d992c9b-66c8-4bd9-b78e-51e13d662144_del complete
Aug 17 08:31:22 user nova-compute[72998]: INFO nova.compute.manager [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 08:31:22 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:31:22 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:31:22 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Took 0.53 seconds to deallocate network for instance.
Aug 17 08:31:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261068.3392284, 14587314-30ee-4661-8800-bf1391b1500b => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:31:23 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 14587314-30ee-4661-8800-bf1391b1500b] VM Stopped (Lifecycle Event)
Aug 17 08:31:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5fcd6aa7-f8b7-401e-b989-c28e8d784a6c None None] [instance: 14587314-30ee-4661-8800-bf1391b1500b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:23 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Deleted allocations for instance 0d992c9b-66c8-4bd9-b78e-51e13d662144
Aug 17 08:31:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-62735ab8-0219-413c-be86-bad0c6a40306 tempest-ServerRescueNegativeTestJSON-826615417 tempest-ServerRescueNegativeTestJSON-826615417-project-member] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.926s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-959f0772-9d43-406b-a397-9f697756c16d req-89d9652a-7353-4567-8e50-eaa0094e5f3b service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-959f0772-9d43-406b-a397-9f697756c16d req-89d9652a-7353-4567-8e50-eaa0094e5f3b service nova] Acquiring lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-959f0772-9d43-406b-a397-9f697756c16d req-89d9652a-7353-4567-8e50-eaa0094e5f3b service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-959f0772-9d43-406b-a397-9f697756c16d req-89d9652a-7353-4567-8e50-eaa0094e5f3b service nova] Lock "0d992c9b-66c8-4bd9-b78e-51e13d662144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-959f0772-9d43-406b-a397-9f697756c16d req-89d9652a-7353-4567-8e50-eaa0094e5f3b service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] No waiting events found dispatching network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:23 user nova-compute[72998]: WARNING nova.compute.manager [req-959f0772-9d43-406b-a397-9f697756c16d req-89d9652a-7353-4567-8e50-eaa0094e5f3b service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received unexpected event network-vif-plugged-75d77dae-ff35-4dee-a471-39e1476dd39e for instance with vm_state deleted and task_state None.
Aug 17 08:31:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-959f0772-9d43-406b-a397-9f697756c16d req-89d9652a-7353-4567-8e50-eaa0094e5f3b service nova] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Received event network-vif-deleted-75d77dae-ff35-4dee-a471-39e1476dd39e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:26 user nova-compute[72998]: INFO nova.compute.manager [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Detaching volume 05fd941a-05d8-4754-bda6-e370cbfddbd2
Aug 17 08:31:26 user nova-compute[72998]: INFO nova.virt.block_device [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Attempting to driver detach volume 05fd941a-05d8-4754-bda6-e370cbfddbd2 from mountpoint /dev/vdb
Aug 17 08:31:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Attempting to detach device vdb from instance cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:31:26 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:31:26 user nova-compute[72998]:   <source dev="/dev/sde"/>
Aug 17 08:31:26 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:31:26 user nova-compute[72998]:   <serial>05fd941a-05d8-4754-bda6-e370cbfddbd2</serial>
Aug 17 08:31:26 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:31:26 user nova-compute[72998]: </disk>
Aug 17 08:31:26 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:31:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Successfully detached device vdb from instance cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 from the persistent domain config.
Aug 17 08:31:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:31:26 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:31:26 user nova-compute[72998]:   <source dev="/dev/sde"/>
Aug 17 08:31:26 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:31:26 user nova-compute[72998]:   <serial>05fd941a-05d8-4754-bda6-e370cbfddbd2</serial>
Aug 17 08:31:26 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:31:26 user nova-compute[72998]: </disk>
Aug 17 08:31:26 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692261086.943171, cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:31:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Successfully detached device vdb from instance cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 from the live domain config.
Aug 17 08:31:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTQXmYWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:31:26 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:31:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ea50de-6776-4a41-89db-0524dfc9f61e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b3610c-b61c-4df0-b078-a41e83a946ca]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:31:27 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:31:27 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:31:27 user nova-compute[72998]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 (non-flash)
Aug 17 08:31:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:31:27 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:31:27 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:31:27 user nova-compute[72998]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 (non-flash)
Aug 17 08:31:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464dbf0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2'): ({'sde'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Removing single pathed devices sde {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b20864b-b131-4d2b-ba96-0a226fc9e173]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5fe4e6-7426-419f-aee0-03ec1587d8be]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Flushing IO for device /dev/sde {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6040efe7-3e1e-4879-b262-1aabafccca1c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a56cbdd-2144-4fb2-a9bb-d6b061570ce8]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[089ff0ba-4894-450d-a225-06b743c79484]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2887c82a-41c5-4776-9c68-88e5f186f317]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2, portal: 172.16.0.220,3260]
Aug 17 08:31:27 user nova-compute[72998]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2, portal: 172.16.0.220,3260] successful.
Aug 17 08:31:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad8b584-480f-4e88-81f6-fcc646290134]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] <== disconnect_volume: return (280ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:31:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'flavor' on Instance uuid cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7198291e-9b40-430a-98f5-a7c8cddd10b4 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.549s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:28 user nova-compute[72998]: INFO nova.compute.manager [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Terminating instance
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-6f00d5f0-6b1b-48b1-8e3c-c9913cd50588 req-a12a98e6-b665-4b37-a614-a4633539f13c service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received event network-vif-unplugged-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6f00d5f0-6b1b-48b1-8e3c-c9913cd50588 req-a12a98e6-b665-4b37-a614-a4633539f13c service nova] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6f00d5f0-6b1b-48b1-8e3c-c9913cd50588 req-a12a98e6-b665-4b37-a614-a4633539f13c service nova] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6f00d5f0-6b1b-48b1-8e3c-c9913cd50588 req-a12a98e6-b665-4b37-a614-a4633539f13c service nova] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-6f00d5f0-6b1b-48b1-8e3c-c9913cd50588 req-a12a98e6-b665-4b37-a614-a4633539f13c service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] No waiting events found dispatching network-vif-unplugged-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-6f00d5f0-6b1b-48b1-8e3c-c9913cd50588 req-a12a98e6-b665-4b37-a614-a4633539f13c service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received event network-vif-unplugged-aedfec88-8b06-4f74-a916-2d99204d272e for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Instance destroyed successfully.
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lazy-loading 'resources' on Instance uuid cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-731736617',display_name='tempest-VolumesSnapshotTestJSON-instance-731736617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-731736617',id=28,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1vtHf85dhCI/V20llhEJuwTCXMUeNJiO7ecPJjndYirvT63J6PWLYr+f0MCrMa4cKoNGMellcxiNX6+LGl/QBrj9LlQHLgmXffLtpBVUNA1TqjBH4eBa5THpXt6qAPTg==',key_name='tempest-keypair-1312878765',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:28:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6c1ee7c1e04088ae7a3e952743576c',ramdisk_id='',reservation_id='r-3rvzj2ew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-20738309',owner_user_name='tempest-VolumesSnapshotTestJSON-20738309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='963659ce0d9c4e04bf345d4a98080e89',uuid=cc94ef0e-79ee-47c9-8e06-0e4c7f8db886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converting VIF {"id": "aedfec88-8b06-4f74-a916-2d99204d272e", "address": "fa:16:3e:fe:cb:13", "network": {"id": "25cac044-e879-40b9-9578-ca63d200eac2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1856259553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c1ee7c1e04088ae7a3e952743576c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaedfec88-8b", "ovs_interfaceid": "aedfec88-8b06-4f74-a916-2d99204d272e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:cb:13,bridge_name='br-int',has_traffic_filtering=True,id=aedfec88-8b06-4f74-a916-2d99204d272e,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaedfec88-8b') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_vif [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:cb:13,bridge_name='br-int',has_traffic_filtering=True,id=aedfec88-8b06-4f74-a916-2d99204d272e,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaedfec88-8b') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaedfec88-8b, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:28 user nova-compute[72998]: INFO os_vif [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:cb:13,bridge_name='br-int',has_traffic_filtering=True,id=aedfec88-8b06-4f74-a916-2d99204d272e,network=Network(25cac044-e879-40b9-9578-ca63d200eac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaedfec88-8b')
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTQXmYWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:31:28 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05fd941a-05d8-4754-bda6-e370cbfddbd2', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37375ba-c196-4ea1-9b2b-91dfb8a73b2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[296c6450-af5b-4cd6-a30a-f75a20e41c6b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:31:28 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:31:28 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:31:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:31:28 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:31:28 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:31:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4883e4280>, {}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Disconnecting from: [] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] <== disconnect_volume: return (51ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:31:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Deleting instance files /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886_del
Aug 17 08:31:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Deletion of /opt/stack/data/nova/instances/cc94ef0e-79ee-47c9-8e06-0e4c7f8db886_del complete
Aug 17 08:31:28 user nova-compute[72998]: INFO nova.compute.manager [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 08:31:28 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:31:28 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:31:29 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:31:29 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Took 0.81 seconds to deallocate network for instance.
Aug 17 08:31:29 user nova-compute[72998]: WARNING nova.volume.cinder [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Attachment cf1abdf9-40e9-4ad3-897e-1c5f61d0c85f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cf1abdf9-40e9-4ad3-897e-1c5f61d0c85f. (HTTP 404) (Request-ID: req-de1186a4-521b-494d-a2ff-13678de509dc)
Aug 17 08:31:29 user nova-compute[72998]: INFO nova.compute.manager [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 08:31:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:30 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Deleted allocations for instance cc94ef0e-79ee-47c9-8e06-0e4c7f8db886
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-bc7163f5-636d-4a0e-98ac-8551853bf9d6 tempest-VolumesSnapshotTestJSON-20738309 tempest-VolumesSnapshotTestJSON-20738309-project-member] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.206s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-d14f40ab-f185-4881-ade5-2dc31d3579f9 req-a4c4d1a6-6ca9-4ae5-b75d-6e530d9721da service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received event network-vif-plugged-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d14f40ab-f185-4881-ade5-2dc31d3579f9 req-a4c4d1a6-6ca9-4ae5-b75d-6e530d9721da service nova] Acquiring lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d14f40ab-f185-4881-ade5-2dc31d3579f9 req-a4c4d1a6-6ca9-4ae5-b75d-6e530d9721da service nova] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d14f40ab-f185-4881-ade5-2dc31d3579f9 req-a4c4d1a6-6ca9-4ae5-b75d-6e530d9721da service nova] Lock "cc94ef0e-79ee-47c9-8e06-0e4c7f8db886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-d14f40ab-f185-4881-ade5-2dc31d3579f9 req-a4c4d1a6-6ca9-4ae5-b75d-6e530d9721da service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] No waiting events found dispatching network-vif-plugged-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:30 user nova-compute[72998]: WARNING nova.compute.manager [req-d14f40ab-f185-4881-ade5-2dc31d3579f9 req-a4c4d1a6-6ca9-4ae5-b75d-6e530d9721da service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received unexpected event network-vif-plugged-aedfec88-8b06-4f74-a916-2d99204d272e for instance with vm_state deleted and task_state None.
Aug 17 08:31:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-d14f40ab-f185-4881-ade5-2dc31d3579f9 req-a4c4d1a6-6ca9-4ae5-b75d-6e530d9721da service nova] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Received event network-vif-deleted-aedfec88-8b06-4f74-a916-2d99204d272e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:30 user nova-compute[72998]: INFO nova.compute.manager [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Terminating instance
Aug 17 08:31:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-c7001137-31ea-49f3-a5ed-e1a9273be946 req-ebfbfd0f-0a1e-4bf7-bfe3-4879d693b609 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-unplugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c7001137-31ea-49f3-a5ed-e1a9273be946 req-ebfbfd0f-0a1e-4bf7-bfe3-4879d693b609 service nova] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c7001137-31ea-49f3-a5ed-e1a9273be946 req-ebfbfd0f-0a1e-4bf7-bfe3-4879d693b609 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c7001137-31ea-49f3-a5ed-e1a9273be946 req-ebfbfd0f-0a1e-4bf7-bfe3-4879d693b609 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-c7001137-31ea-49f3-a5ed-e1a9273be946 req-ebfbfd0f-0a1e-4bf7-bfe3-4879d693b609 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] No waiting events found dispatching network-vif-unplugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-c7001137-31ea-49f3-a5ed-e1a9273be946 req-ebfbfd0f-0a1e-4bf7-bfe3-4879d693b609 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-unplugged-5160fa81-e465-4cf0-b0a0-862256c60f8b for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Instance destroyed successfully.
Aug 17 08:31:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lazy-loading 'resources' on Instance uuid 382786b5-2479-4260-8be7-e56513d85fb3 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2116780994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2116780994',id=26,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBTxnYxvo0uWtR5DDPn4Y7ih+7xoHXCALaDB711cb16A/xwqCq8+SdyaE419S/Pag051ZYUroUtYYfDERIa7JrJbquhP62+TE9hkelD8yUpjZ2kPnUfiyH8ECV7KdfEzw==',key_name='tempest-keypair-1914279933',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846580b37b3545319d1897e07c828c59',ramdisk_id='',reservation_id='r-zjvfbzbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-257833239',owner_user_name='tempest-AttachVolumeShelveTestJSON-257833239-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8febbec4ce4eb9a0132c51fae76de1',uuid=382786b5-2479-4260-8be7-e56513d85fb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converting VIF {"id": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "address": "fa:16:3e:51:39:e0", "network": {"id": "ce183367-6c1b-4587-8e85-47a9c0c3c1e1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1413828869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846580b37b3545319d1897e07c828c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5160fa81-e4", "ovs_interfaceid": "5160fa81-e465-4cf0-b0a0-862256c60f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG os_vif [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5160fa81-e4, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:31 user nova-compute[72998]: INFO os_vif [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=5160fa81-e465-4cf0-b0a0-862256c60f8b,network=Network(ce183367-6c1b-4587-8e85-47a9c0c3c1e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5160fa81-e4')
Aug 17 08:31:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Deleting instance files /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3_del
Aug 17 08:31:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Deletion of /opt/stack/data/nova/instances/382786b5-2479-4260-8be7-e56513d85fb3_del complete
Aug 17 08:31:31 user nova-compute[72998]: INFO nova.compute.manager [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 17 08:31:31 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:31:31 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:31:32 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:31:32 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Took 0.76 seconds to deallocate network for instance.
Aug 17 08:31:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-a76c14f7-a5e3-4555-875d-dad32c253932 req-63c1c5f7-b76c-43d4-bec9-8aaf95c481a9 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-deleted-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:32 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:31:32 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:31:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:32 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Deleted allocations for instance 382786b5-2479-4260-8be7-e56513d85fb3
Aug 17 08:31:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-765b2d5a-e8b9-49d0-b0c0-48f2c71d81f4 tempest-AttachVolumeShelveTestJSON-257833239 tempest-AttachVolumeShelveTestJSON-257833239-project-member] Lock "382786b5-2479-4260-8be7-e56513d85fb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-484b1f22-c2ed-4264-adc1-38574e2afa96 req-c652891c-a664-452c-8631-700ff6aa55c2 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:31:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-484b1f22-c2ed-4264-adc1-38574e2afa96 req-c652891c-a664-452c-8631-700ff6aa55c2 service nova] Acquiring lock "382786b5-2479-4260-8be7-e56513d85fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:31:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-484b1f22-c2ed-4264-adc1-38574e2afa96 req-c652891c-a664-452c-8631-700ff6aa55c2 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:31:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-484b1f22-c2ed-4264-adc1-38574e2afa96 req-c652891c-a664-452c-8631-700ff6aa55c2 service nova] Lock "382786b5-2479-4260-8be7-e56513d85fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:31:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-484b1f22-c2ed-4264-adc1-38574e2afa96 req-c652891c-a664-452c-8631-700ff6aa55c2 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] No waiting events found dispatching network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:31:33 user nova-compute[72998]: WARNING nova.compute.manager [req-484b1f22-c2ed-4264-adc1-38574e2afa96 req-c652891c-a664-452c-8631-700ff6aa55c2 service nova] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Received unexpected event network-vif-plugged-5160fa81-e465-4cf0-b0a0-862256c60f8b for instance with vm_state deleted and task_state None.
Aug 17 08:31:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:37 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261082.3175607, 0d992c9b-66c8-4bd9-b78e-51e13d662144 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:31:37 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] VM Stopped (Lifecycle Event)
Aug 17 08:31:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-feb7516e-6ea7-4a45-a35a-b74dbe0b3401 None None] [instance: 0d992c9b-66c8-4bd9-b78e-51e13d662144] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:31:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:43 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261088.8039005, cc94ef0e-79ee-47c9-8e06-0e4c7f8db886 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:31:43 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] VM Stopped (Lifecycle Event)
Aug 17 08:31:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-62323d7a-2459-4f5b-b180-30f649f8959e None None] [instance: cc94ef0e-79ee-47c9-8e06-0e4c7f8db886] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:31:46 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261091.4481745, 382786b5-2479-4260-8be7-e56513d85fb3 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:31:46 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] VM Stopped (Lifecycle Event)
Aug 17 08:31:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b5048ad7-a0e9-41a9-b23d-de79e374b4d5 None None] [instance: 382786b5-2479-4260-8be7-e56513d85fb3] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:31:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:32:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:32:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:32:06 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:32:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updating instance_info_cache with network_info: [{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:32:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:32:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquired lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'info_cache' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updating instance_info_cache with network_info: [{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Releasing lock "refresh_cache-87850ffb-dfa9-4b23-bd18-938744cd9b5f" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:32:11 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance destroyed successfully.
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'resources' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1003522619',display_name='tempest-AttachVolumeTestJSON-server-1003522619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1003522619',id=22,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmc8qbkgbu95dJvwY1bo5kn9RJpsYoyrns3+CWvhffMSTP6KyY1SbvmOYfexUjDzD3737D3c8fhHlVWQh2nyWElT5uU1HwkwSVrOW/xi1hx6Ymm9am4ZS8Qy8EFRomqnw==',key_name='tempest-keypair-346425477',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-h31cebic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:30:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=87850ffb-dfa9-4b23-bd18-938744cd9b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG os_vif [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85901016-fa, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:32:11 user nova-compute[72998]: INFO os_vif [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa')
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Start _get_guest_xml network_info=[{"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'numa_topology' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:32:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1003522619',display_name='tempest-AttachVolumeTestJSON-server-1003522619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1003522619',id=22,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmc8qbkgbu95dJvwY1bo5kn9RJpsYoyrns3+CWvhffMSTP6KyY1SbvmOYfexUjDzD3737D3c8fhHlVWQh2nyWElT5uU1HwkwSVrOW/xi1hx6Ymm9am4ZS8Qy8EFRomqnw==',key_name='tempest-keypair-346425477',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-h31cebic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:30:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=87850ffb-dfa9-4b23-bd18-938744cd9b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'pci_devices' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:32:11 user nova-compute[72998]:   <uuid>87850ffb-dfa9-4b23-bd18-938744cd9b5f</uuid>
Aug 17 08:32:11 user nova-compute[72998]:   <name>instance-00000016</name>
Aug 17 08:32:11 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:32:11 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:32:11 user nova-compute[72998]:   <metadata>
Aug 17 08:32:11 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:32:11 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:32:11 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeTestJSON-server-1003522619</nova:name>
Aug 17 08:32:11 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:32:11</nova:creationTime>
Aug 17 08:32:11 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:32:11 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:32:11 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:32:11 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:32:11 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:32:11 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:32:11 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:32:11 user nova-compute[72998]:       <nova:owner>
Aug 17 08:32:11 user nova-compute[72998]:         <nova:user uuid="dedd991048b34559acc5465faf521198">tempest-AttachVolumeTestJSON-1538733103-project-member</nova:user>
Aug 17 08:32:11 user nova-compute[72998]:         <nova:project uuid="be77012255394ad0bab402375507d6ef">tempest-AttachVolumeTestJSON-1538733103</nova:project>
Aug 17 08:32:11 user nova-compute[72998]:       </nova:owner>
Aug 17 08:32:11 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:32:11 user nova-compute[72998]:       <nova:ports>
Aug 17 08:32:11 user nova-compute[72998]:         <nova:port uuid="85901016-fa8e-4d52-9229-caa63c02bea3">
Aug 17 08:32:11 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 08:32:11 user nova-compute[72998]:         </nova:port>
Aug 17 08:32:11 user nova-compute[72998]:       </nova:ports>
Aug 17 08:32:11 user nova-compute[72998]:     </nova:instance>
Aug 17 08:32:11 user nova-compute[72998]:   </metadata>
Aug 17 08:32:11 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:32:11 user nova-compute[72998]:     <system>
Aug 17 08:32:11 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:32:11 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:32:11 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:32:11 user nova-compute[72998]:       <entry name="serial">87850ffb-dfa9-4b23-bd18-938744cd9b5f</entry>
Aug 17 08:32:11 user nova-compute[72998]:       <entry name="uuid">87850ffb-dfa9-4b23-bd18-938744cd9b5f</entry>
Aug 17 08:32:11 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:32:11 user nova-compute[72998]:     </system>
Aug 17 08:32:11 user nova-compute[72998]:   </sysinfo>
Aug 17 08:32:11 user nova-compute[72998]:   <os>
Aug 17 08:32:11 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:32:11 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:32:11 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:32:11 user nova-compute[72998]:   </os>
Aug 17 08:32:11 user nova-compute[72998]:   <features>
Aug 17 08:32:11 user nova-compute[72998]:     <acpi/>
Aug 17 08:32:11 user nova-compute[72998]:     <apic/>
Aug 17 08:32:11 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:32:11 user nova-compute[72998]:   </features>
Aug 17 08:32:11 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:32:11 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:32:11 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:32:11 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:32:11 user nova-compute[72998]:   </clock>
Aug 17 08:32:11 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:32:11 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:32:11 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:32:11 user nova-compute[72998]:   </cpu>
Aug 17 08:32:11 user nova-compute[72998]:   <devices>
Aug 17 08:32:11 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:32:11 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:32:11 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk"/>
Aug 17 08:32:11 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:32:11 user nova-compute[72998]:     </disk>
Aug 17 08:32:11 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:32:11 user nova-compute[72998]:       <mac address="fa:16:3e:9c:31:a6"/>
Aug 17 08:32:11 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:32:11 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:32:11 user nova-compute[72998]:       <target dev="tap85901016-fa"/>
Aug 17 08:32:11 user nova-compute[72998]:     </interface>
Aug 17 08:32:11 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:32:11 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/console.log" append="off"/>
Aug 17 08:32:11 user nova-compute[72998]:     </serial>
Aug 17 08:32:11 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:32:11 user nova-compute[72998]:     <video>
Aug 17 08:32:11 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:32:11 user nova-compute[72998]:     </video>
Aug 17 08:32:11 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:32:11 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:32:11 user nova-compute[72998]:     </rng>
Aug 17 08:32:11 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:32:11 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:32:11 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:32:11 user nova-compute[72998]:     </memballoon>
Aug 17 08:32:11 user nova-compute[72998]:   </devices>
Aug 17 08:32:11 user nova-compute[72998]: </domain>
Aug 17 08:32:11 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Cannot resize image /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'migration_context' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1003522619',display_name='tempest-AttachVolumeTestJSON-server-1003522619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1003522619',id=22,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmc8qbkgbu95dJvwY1bo5kn9RJpsYoyrns3+CWvhffMSTP6KyY1SbvmOYfexUjDzD3737D3c8fhHlVWQh2nyWElT5uU1HwkwSVrOW/xi1hx6Ymm9am4ZS8Qy8EFRomqnw==',key_name='tempest-keypair-346425477',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-h31cebic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:30:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=87850ffb-dfa9-4b23-bd18-938744cd9b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG os_vif [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85901016-fa, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85901016-fa, col_values=(('external_ids', {'iface-id': '85901016-fa8e-4d52-9229-caa63c02bea3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:31:a6', 'vm-uuid': '87850ffb-dfa9-4b23-bd18-938744cd9b5f'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:12 user nova-compute[72998]: INFO os_vif [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa')
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:32:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:32:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261136.0922375, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:32:16 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] VM Resumed (Lifecycle Event)
Aug 17 08:32:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-6847a156-b1f4-438f-95ac-cc6f69943f0c req-0b1fdceb-3de1-4c20-b93a-5a18379e8868 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6847a156-b1f4-438f-95ac-cc6f69943f0c req-0b1fdceb-3de1-4c20-b93a-5a18379e8868 service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6847a156-b1f4-438f-95ac-cc6f69943f0c req-0b1fdceb-3de1-4c20-b93a-5a18379e8868 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6847a156-b1f4-438f-95ac-cc6f69943f0c req-0b1fdceb-3de1-4c20-b93a-5a18379e8868 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-6847a156-b1f4-438f-95ac-cc6f69943f0c req-0b1fdceb-3de1-4c20-b93a-5a18379e8868 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:16 user nova-compute[72998]: WARNING nova.compute.manager [req-6847a156-b1f4-438f-95ac-cc6f69943f0c req-0b1fdceb-3de1-4c20-b93a-5a18379e8868 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state stopped and task_state powering-on.
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-4cf7167f-b84e-4173-a313-7072a77b3b64 req-d546dfe8-aa8b-4d3e-b0e3-2647a4d01e06 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4cf7167f-b84e-4173-a313-7072a77b3b64 req-d546dfe8-aa8b-4d3e-b0e3-2647a4d01e06 service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4cf7167f-b84e-4173-a313-7072a77b3b64 req-d546dfe8-aa8b-4d3e-b0e3-2647a4d01e06 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4cf7167f-b84e-4173-a313-7072a77b3b64 req-d546dfe8-aa8b-4d3e-b0e3-2647a4d01e06 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-4cf7167f-b84e-4173-a313-7072a77b3b64 req-d546dfe8-aa8b-4d3e-b0e3-2647a4d01e06 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:16 user nova-compute[72998]: WARNING nova.compute.manager [req-4cf7167f-b84e-4173-a313-7072a77b3b64 req-d546dfe8-aa8b-4d3e-b0e3-2647a4d01e06 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state stopped and task_state powering-on.
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:32:16 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:32:16 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=24.132598876953125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:16 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance rebooted successfully.
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7070a48e-3725-4868-b79e-6fef51d250d0 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:32:16 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261136.0923884, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:32:16 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] VM Started (Lifecycle Event)
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 603c6577-f34a-450d-a137-603469e19ede actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:32:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:17 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:32:17 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:32:17 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:32:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:32:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:32:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:23 user nova-compute[72998]: INFO nova.compute.manager [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Terminating instance
Aug 17 08:32:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-2a29f730-2609-467c-8b1d-bf6ca36b2143 req-763ed77a-a4fd-4672-9f81-58c675c9fea1 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-unplugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2a29f730-2609-467c-8b1d-bf6ca36b2143 req-763ed77a-a4fd-4672-9f81-58c675c9fea1 service nova] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2a29f730-2609-467c-8b1d-bf6ca36b2143 req-763ed77a-a4fd-4672-9f81-58c675c9fea1 service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2a29f730-2609-467c-8b1d-bf6ca36b2143 req-763ed77a-a4fd-4672-9f81-58c675c9fea1 service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-2a29f730-2609-467c-8b1d-bf6ca36b2143 req-763ed77a-a4fd-4672-9f81-58c675c9fea1 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] No waiting events found dispatching network-vif-unplugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-2a29f730-2609-467c-8b1d-bf6ca36b2143 req-763ed77a-a4fd-4672-9f81-58c675c9fea1 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-unplugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:32:23 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] Instance destroyed successfully.
Aug 17 08:32:23 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'resources' on Instance uuid 603c6577-f34a-450d-a137-603469e19ede {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405697983',display_name='tempest-ServerActionsTestOtherA-server-1405697983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405697983',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwso8zXzyr8rdW+F3TIWTcGQW2195HR8rtDbyl+3RZbz4rT8sA0T1Nq594b2NMeWJ/ZCBUqUIDbRSEtao2k3JmymnhZIpHBjG50mdl6hk0l6mAeujcqHjcduFAXBAHWg==',key_name='tempest-keypair-622925506',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:28:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-ss81oka0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=603c6577-f34a-450d-a137-603469e19ede,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "address": "fa:16:3e:24:5f:81", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726f4b3e-5f", "ovs_interfaceid": "726f4b3e-5fa4-4747-8f97-a1c7853bf57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG os_vif [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap726f4b3e-5f, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:24 user nova-compute[72998]: INFO os_vif [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726f4b3e-5f')
Aug 17 08:32:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nvkbCdPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:32:24 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbac1ff-ca46-4a80-86f9-102426ba86b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5550998-3b1e-4e8a-ab92-83978adc2381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c506f5-eb5c-4a3c-909a-072159f35b9a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5550998-3b1e-4e8a-ab92-83978adc2381 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:32:24 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:32:24 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:32:24 user nova-compute[72998]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5550998-3b1e-4e8a-ab92-83978adc2381 (non-flash)
Aug 17 08:32:24 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:32:24 user nova-compute[72998]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 (non-flash)
Aug 17 08:32:24 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:32:24 user nova-compute[72998]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5550998-3b1e-4e8a-ab92-83978adc2381 (non-flash)
Aug 17 08:32:24 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4886bfac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5'): ({'sdd'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Removing single pathed devices sdd {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ecbdf7-3cb7-4526-8d07-a8ca175fcc81]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba5394a-e32a-4fa7-85eb-3b2e9cc672a2]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Flushing IO for device /dev/sdd {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.040s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8653d248-7b66-46ab-93e9-a1be3fdfd81c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96fde14-e340-4781-8068-dadb4111ffc8]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[89be3b0e-3f68-4f19-9f0e-3bd6578fbfff]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[06273b5e-7641-448b-b66e-4be00c763629]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260]
Aug 17 08:32:24 user nova-compute[72998]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5, portal: 172.16.0.220,3260] successful.
Aug 17 08:32:24 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb70aa3-b710-4008-951d-e0e5efb221b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[52270cd8-83a3-47b2-bbaf-dce6214af783]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] <== disconnect_volume: return (480ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:32:24 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Deleting instance files /opt/stack/data/nova/instances/603c6577-f34a-450d-a137-603469e19ede_del
Aug 17 08:32:24 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Deletion of /opt/stack/data/nova/instances/603c6577-f34a-450d-a137-603469e19ede_del complete
Aug 17 08:32:24 user nova-compute[72998]: INFO nova.compute.manager [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Took 1.57 seconds to destroy the instance on the hypervisor.
Aug 17 08:32:24 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:32:24 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:32:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-1538eb09-1b55-42c6-95b5-f31f71f1f4c3 req-8ad77dbe-27d0-474c-b095-97dc028be763 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1538eb09-1b55-42c6-95b5-f31f71f1f4c3 req-8ad77dbe-27d0-474c-b095-97dc028be763 service nova] Acquiring lock "603c6577-f34a-450d-a137-603469e19ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1538eb09-1b55-42c6-95b5-f31f71f1f4c3 req-8ad77dbe-27d0-474c-b095-97dc028be763 service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1538eb09-1b55-42c6-95b5-f31f71f1f4c3 req-8ad77dbe-27d0-474c-b095-97dc028be763 service nova] Lock "603c6577-f34a-450d-a137-603469e19ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-1538eb09-1b55-42c6-95b5-f31f71f1f4c3 req-8ad77dbe-27d0-474c-b095-97dc028be763 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] No waiting events found dispatching network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:25 user nova-compute[72998]: WARNING nova.compute.manager [req-1538eb09-1b55-42c6-95b5-f31f71f1f4c3 req-8ad77dbe-27d0-474c-b095-97dc028be763 service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received unexpected event network-vif-plugged-726f4b3e-5fa4-4747-8f97-a1c7853bf57e for instance with vm_state active and task_state deleting.
Aug 17 08:32:26 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:32:26 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] Took 2.28 seconds to deallocate network for instance.
Aug 17 08:32:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-c3b5463d-6a16-43c5-8895-cd2951bd972a req-e0e5abcf-d698-4bfb-8e6f-28a0428ac58a service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Received event network-vif-deleted-726f4b3e-5fa4-4747-8f97-a1c7853bf57e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:26 user nova-compute[72998]: INFO nova.compute.manager [req-c3b5463d-6a16-43c5-8895-cd2951bd972a req-e0e5abcf-d698-4bfb-8e6f-28a0428ac58a service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Neutron deleted interface 726f4b3e-5fa4-4747-8f97-a1c7853bf57e; detaching it from the instance and deleting it from the info cache
Aug 17 08:32:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-c3b5463d-6a16-43c5-8895-cd2951bd972a req-e0e5abcf-d698-4bfb-8e6f-28a0428ac58a service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:32:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-c3b5463d-6a16-43c5-8895-cd2951bd972a req-e0e5abcf-d698-4bfb-8e6f-28a0428ac58a service nova] [instance: 603c6577-f34a-450d-a137-603469e19ede] Detach interface failed, port_id=726f4b3e-5fa4-4747-8f97-a1c7853bf57e, reason: Instance 603c6577-f34a-450d-a137-603469e19ede could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:32:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:28 user nova-compute[72998]: INFO nova.compute.manager [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Took 1.08 seconds to detach 1 volumes for instance.
Aug 17 08:32:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: 603c6577-f34a-450d-a137-603469e19ede] Deleting volume: 9fb70aa3-b710-4008-951d-e0e5efb221b5 {{(pid=72998) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 08:32:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:28 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:32:28 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:32:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:28 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Deleted allocations for instance 603c6577-f34a-450d-a137-603469e19ede
Aug 17 08:32:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8f78a76-281b-4d79-bd9e-d7632dcb085d tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "603c6577-f34a-450d-a137-603469e19ede" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.774s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:32:32 user nova-compute[72998]: INFO nova.compute.claims [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Claim successful on node user
Aug 17 08:32:32 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:32:32 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:32:33 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:32:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG nova.policy [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f38547b6181642c8b51ff26c5cece96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cd55d2a46440109d871d95b275ee35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:32:33 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Creating image(s)
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "/opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "/opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.260s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.244s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk 1073741824" returned: 0 in 0.054s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.223s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Successfully created port: 39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Cannot resize image /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lazy-loading 'migration_context' on Instance uuid 3f5ecb29-58b4-4f01-bf32-633fffee8d59 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Ensure instance console log exists: /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Successfully updated port: 39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquired lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-a5484a9e-183a-4c81-b6fd-26685d12fe39 req-04c22699-3922-4f08-9728-ead6a6078ab3 service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received event network-changed-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-a5484a9e-183a-4c81-b6fd-26685d12fe39 req-04c22699-3922-4f08-9728-ead6a6078ab3 service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Refreshing instance network info cache due to event network-changed-39b5d6f0-f61f-40cc-9b65-ca95b4c74847. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a5484a9e-183a-4c81-b6fd-26685d12fe39 req-04c22699-3922-4f08-9728-ead6a6078ab3 service nova] Acquiring lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Updating instance_info_cache with network_info: [{"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Releasing lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Instance network_info: |[{"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a5484a9e-183a-4c81-b6fd-26685d12fe39 req-04c22699-3922-4f08-9728-ead6a6078ab3 service nova] Acquired lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-a5484a9e-183a-4c81-b6fd-26685d12fe39 req-04c22699-3922-4f08-9728-ead6a6078ab3 service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Refreshing network info cache for port 39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Start _get_guest_xml network_info=[{"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:32:35 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:32:35 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-808450072',display_name='tempest-ServersNegativeTestJSON-server-808450072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-808450072',id=31,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80cd55d2a46440109d871d95b275ee35',ramdisk_id='',reservation_id='r-zapalxje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-767382591',owner_user_name='tempest-ServersNegativeTestJSON-767382591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:32:33Z,user_data=None,user_id='f38547b6181642c8b51ff26c5cece96a',uuid=3f5ecb29-58b4-4f01-bf32-633fffee8d59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converting VIF {"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ae:05,bridge_name='br-int',has_traffic_filtering=True,id=39b5d6f0-f61f-40cc-9b65-ca95b4c74847,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5d6f0-f6') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f5ecb29-58b4-4f01-bf32-633fffee8d59 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:32:35 user nova-compute[72998]:   <uuid>3f5ecb29-58b4-4f01-bf32-633fffee8d59</uuid>
Aug 17 08:32:35 user nova-compute[72998]:   <name>instance-0000001f</name>
Aug 17 08:32:35 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:32:35 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:32:35 user nova-compute[72998]:   <metadata>
Aug 17 08:32:35 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:32:35 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:32:35 user nova-compute[72998]:       <nova:name>tempest-ServersNegativeTestJSON-server-808450072</nova:name>
Aug 17 08:32:35 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:32:35</nova:creationTime>
Aug 17 08:32:35 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:32:35 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:32:35 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:32:35 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:32:35 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:32:35 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:32:35 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:32:35 user nova-compute[72998]:       <nova:owner>
Aug 17 08:32:35 user nova-compute[72998]:         <nova:user uuid="f38547b6181642c8b51ff26c5cece96a">tempest-ServersNegativeTestJSON-767382591-project-member</nova:user>
Aug 17 08:32:35 user nova-compute[72998]:         <nova:project uuid="80cd55d2a46440109d871d95b275ee35">tempest-ServersNegativeTestJSON-767382591</nova:project>
Aug 17 08:32:35 user nova-compute[72998]:       </nova:owner>
Aug 17 08:32:35 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:32:35 user nova-compute[72998]:       <nova:ports>
Aug 17 08:32:35 user nova-compute[72998]:         <nova:port uuid="39b5d6f0-f61f-40cc-9b65-ca95b4c74847">
Aug 17 08:32:35 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 08:32:35 user nova-compute[72998]:         </nova:port>
Aug 17 08:32:35 user nova-compute[72998]:       </nova:ports>
Aug 17 08:32:35 user nova-compute[72998]:     </nova:instance>
Aug 17 08:32:35 user nova-compute[72998]:   </metadata>
Aug 17 08:32:35 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:32:35 user nova-compute[72998]:     <system>
Aug 17 08:32:35 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:32:35 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:32:35 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:32:35 user nova-compute[72998]:       <entry name="serial">3f5ecb29-58b4-4f01-bf32-633fffee8d59</entry>
Aug 17 08:32:35 user nova-compute[72998]:       <entry name="uuid">3f5ecb29-58b4-4f01-bf32-633fffee8d59</entry>
Aug 17 08:32:35 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:32:35 user nova-compute[72998]:     </system>
Aug 17 08:32:35 user nova-compute[72998]:   </sysinfo>
Aug 17 08:32:35 user nova-compute[72998]:   <os>
Aug 17 08:32:35 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:32:35 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:32:35 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:32:35 user nova-compute[72998]:   </os>
Aug 17 08:32:35 user nova-compute[72998]:   <features>
Aug 17 08:32:35 user nova-compute[72998]:     <acpi/>
Aug 17 08:32:35 user nova-compute[72998]:     <apic/>
Aug 17 08:32:35 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:32:35 user nova-compute[72998]:   </features>
Aug 17 08:32:35 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:32:35 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:32:35 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:32:35 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:32:35 user nova-compute[72998]:   </clock>
Aug 17 08:32:35 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:32:35 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:32:35 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:32:35 user nova-compute[72998]:   </cpu>
Aug 17 08:32:35 user nova-compute[72998]:   <devices>
Aug 17 08:32:35 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:32:35 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:32:35 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk"/>
Aug 17 08:32:35 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:32:35 user nova-compute[72998]:     </disk>
Aug 17 08:32:35 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:32:35 user nova-compute[72998]:       <mac address="fa:16:3e:5b:ae:05"/>
Aug 17 08:32:35 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:32:35 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:32:35 user nova-compute[72998]:       <target dev="tap39b5d6f0-f6"/>
Aug 17 08:32:35 user nova-compute[72998]:     </interface>
Aug 17 08:32:35 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:32:35 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/console.log" append="off"/>
Aug 17 08:32:35 user nova-compute[72998]:     </serial>
Aug 17 08:32:35 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:32:35 user nova-compute[72998]:     <video>
Aug 17 08:32:35 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:32:35 user nova-compute[72998]:     </video>
Aug 17 08:32:35 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:32:35 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:32:35 user nova-compute[72998]:     </rng>
Aug 17 08:32:35 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:32:35 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:32:35 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:32:35 user nova-compute[72998]:     </memballoon>
Aug 17 08:32:35 user nova-compute[72998]:   </devices>
Aug 17 08:32:35 user nova-compute[72998]: </domain>
Aug 17 08:32:35 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-808450072',display_name='tempest-ServersNegativeTestJSON-server-808450072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-808450072',id=31,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80cd55d2a46440109d871d95b275ee35',ramdisk_id='',reservation_id='r-zapalxje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-767382591',owner_user_name='tempest-ServersNegativeTestJSON-767382591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:32:33Z,user_data=None,user_id='f38547b6181642c8b51ff26c5cece96a',uuid=3f5ecb29-58b4-4f01-bf32-633fffee8d59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converting VIF {"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ae:05,bridge_name='br-int',has_traffic_filtering=True,id=39b5d6f0-f61f-40cc-9b65-ca95b4c74847,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5d6f0-f6') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG os_vif [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ae:05,bridge_name='br-int',has_traffic_filtering=True,id=39b5d6f0-f61f-40cc-9b65-ca95b4c74847,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5d6f0-f6') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39b5d6f0-f6, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39b5d6f0-f6, col_values=(('external_ids', {'iface-id': '39b5d6f0-f61f-40cc-9b65-ca95b4c74847', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:ae:05', 'vm-uuid': '3f5ecb29-58b4-4f01-bf32-633fffee8d59'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:35 user nova-compute[72998]: INFO os_vif [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ae:05,bridge_name='br-int',has_traffic_filtering=True,id=39b5d6f0-f61f-40cc-9b65-ca95b4c74847,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5d6f0-f6')
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] No VIF found with MAC fa:16:3e:5b:ae:05, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-a5484a9e-183a-4c81-b6fd-26685d12fe39 req-04c22699-3922-4f08-9728-ead6a6078ab3 service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Updated VIF entry in instance network info cache for port 39b5d6f0-f61f-40cc-9b65-ca95b4c74847. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-a5484a9e-183a-4c81-b6fd-26685d12fe39 req-04c22699-3922-4f08-9728-ead6a6078ab3 service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Updating instance_info_cache with network_info: [{"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:32:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a5484a9e-183a-4c81-b6fd-26685d12fe39 req-04c22699-3922-4f08-9728-ead6a6078ab3 service nova] Releasing lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:32:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-63a12d19-b70f-4263-9170-37cf08b49deb req-3cc793eb-4ea1-41d1-8c0a-abb2d65b0eac service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received event network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63a12d19-b70f-4263-9170-37cf08b49deb req-3cc793eb-4ea1-41d1-8c0a-abb2d65b0eac service nova] Acquiring lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63a12d19-b70f-4263-9170-37cf08b49deb req-3cc793eb-4ea1-41d1-8c0a-abb2d65b0eac service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-63a12d19-b70f-4263-9170-37cf08b49deb req-3cc793eb-4ea1-41d1-8c0a-abb2d65b0eac service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-63a12d19-b70f-4263-9170-37cf08b49deb req-3cc793eb-4ea1-41d1-8c0a-abb2d65b0eac service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] No waiting events found dispatching network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:37 user nova-compute[72998]: WARNING nova.compute.manager [req-63a12d19-b70f-4263-9170-37cf08b49deb req-3cc793eb-4ea1-41d1-8c0a-abb2d65b0eac service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received unexpected event network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 for instance with vm_state building and task_state spawning.
Aug 17 08:32:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:38 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261143.9348826, 603c6577-f34a-450d-a137-603469e19ede => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:32:38 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 603c6577-f34a-450d-a137-603469e19ede] VM Stopped (Lifecycle Event)
Aug 17 08:32:38 user nova-compute[72998]: DEBUG nova.compute.manager [None req-157f29fb-6588-4e85-88de-762cbc6ee273 None None] [instance: 603c6577-f34a-450d-a137-603469e19ede] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261159.4036593, 3f5ecb29-58b4-4f01-bf32-633fffee8d59 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:32:39 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] VM Resumed (Lifecycle Event)
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:32:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Instance spawned successfully.
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:32:39 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261159.4050798, 3f5ecb29-58b4-4f01-bf32-633fffee8d59 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:32:39 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] VM Started (Lifecycle Event)
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:32:39 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-0a9caafd-74ef-4783-a4b6-e37e86b4e8f9 req-fa6f81eb-c85c-45ad-843c-f1dcce67c6b3 service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received event network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0a9caafd-74ef-4783-a4b6-e37e86b4e8f9 req-fa6f81eb-c85c-45ad-843c-f1dcce67c6b3 service nova] Acquiring lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0a9caafd-74ef-4783-a4b6-e37e86b4e8f9 req-fa6f81eb-c85c-45ad-843c-f1dcce67c6b3 service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0a9caafd-74ef-4783-a4b6-e37e86b4e8f9 req-fa6f81eb-c85c-45ad-843c-f1dcce67c6b3 service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-0a9caafd-74ef-4783-a4b6-e37e86b4e8f9 req-fa6f81eb-c85c-45ad-843c-f1dcce67c6b3 service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] No waiting events found dispatching network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:39 user nova-compute[72998]: WARNING nova.compute.manager [req-0a9caafd-74ef-4783-a4b6-e37e86b4e8f9 req-fa6f81eb-c85c-45ad-843c-f1dcce67c6b3 service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received unexpected event network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 for instance with vm_state building and task_state spawning.
Aug 17 08:32:39 user nova-compute[72998]: INFO nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Took 6.32 seconds to spawn the instance on the hypervisor.
Aug 17 08:32:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:32:39 user nova-compute[72998]: INFO nova.compute.manager [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Took 7.19 seconds to build instance.
Aug 17 08:32:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6beca14-9a17-49b9-95ec-1d85d3208bb9 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.299s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:48 user nova-compute[72998]: INFO nova.compute.manager [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Terminating instance
Aug 17 08:32:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-f177aa52-8d59-45cc-bda6-36dd3ba73ef8 req-4f93a526-40ef-4a2a-959b-5f0c2bd76f7f service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f177aa52-8d59-45cc-bda6-36dd3ba73ef8 req-4f93a526-40ef-4a2a-959b-5f0c2bd76f7f service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f177aa52-8d59-45cc-bda6-36dd3ba73ef8 req-4f93a526-40ef-4a2a-959b-5f0c2bd76f7f service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f177aa52-8d59-45cc-bda6-36dd3ba73ef8 req-4f93a526-40ef-4a2a-959b-5f0c2bd76f7f service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-f177aa52-8d59-45cc-bda6-36dd3ba73ef8 req-4f93a526-40ef-4a2a-959b-5f0c2bd76f7f service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-f177aa52-8d59-45cc-bda6-36dd3ba73ef8 req-4f93a526-40ef-4a2a-959b-5f0c2bd76f7f service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Instance destroyed successfully.
Aug 17 08:32:48 user nova-compute[72998]: DEBUG nova.objects.instance [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lazy-loading 'resources' on Instance uuid 4119f28a-b9f1-4996-a144-68edd4f08c44 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1893379751',display_name='tempest-ServerActionsTestOtherB-server-1893379751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1893379751',id=21,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1sywPS7noB6enRkafRCV4V8gUajrQp1IvyFeTNyX5oNNHzp72oZWl7JWE9EVMF5YzyYJVOw45540lSzJ/aE8AmU535jNS6dcszNW9Kp6/r+UbKETYBcWkdMqhnsqo26g==',key_name='tempest-keypair-2137913041',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:30:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90f94111e9fa4659a975f8478d7ca7da',ramdisk_id='',reservation_id='r-t6pdxe0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1997511094',owner_user_name='tempest-ServerActionsTestOtherB-1997511094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:30:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cbf4e4b883f484980af4bde95f8fd88',uuid=4119f28a-b9f1-4996-a144-68edd4f08c44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converting VIF {"id": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "address": "fa:16:3e:36:9d:90", "network": {"id": "657bbe40-1181-4050-89d2-0ba65dfa509b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1268549478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f94111e9fa4659a975f8478d7ca7da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9cd3f5a-80", "ovs_interfaceid": "e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_vif [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9cd3f5a-80, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:32:49 user nova-compute[72998]: INFO os_vif [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9d:90,bridge_name='br-int',has_traffic_filtering=True,id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3,network=Network(657bbe40-1181-4050-89d2-0ba65dfa509b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9cd3f5a-80')
Aug 17 08:32:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCyoBIwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:32:49 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95879c0-bea8-4487-8488-e573d8f56bb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cccf0a1-b6e0-45b3-bc6b-b479013aa966]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:32:49 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:32:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:32:49 user nova-compute[72998]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 (non-flash)
Aug 17 08:32:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488576830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eec20ec-7c08-4fa1-85be-4df27aa37c9f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a24e4a-6414-416d-9f86-29a2bfb8d406]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb2bb8b-343a-42da-a868-bf365cc2605b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b93efa-f06b-46dc-b27d-35facc9df5a9]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af2780e-5f64-47dd-b3bf-88bfe75df85f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d78c2c1-8147-4f5e-a226-79ef2b1cfd02]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260]
Aug 17 08:32:49 user nova-compute[72998]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551, portal: 172.16.0.220,3260] successful.
Aug 17 08:32:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6d5e7f-f3b0-4c02-983b-4594be7d8551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7481b49c-7e32-4b61-b6c6-3b4a282bba28]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] <== disconnect_volume: return (376ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:32:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Deleting instance files /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44_del
Aug 17 08:32:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Deletion of /opt/stack/data/nova/instances/4119f28a-b9f1-4996-a144-68edd4f08c44_del complete
Aug 17 08:32:49 user nova-compute[72998]: INFO nova.compute.manager [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 17 08:32:49 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:50 user nova-compute[72998]: WARNING nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state deleting.
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:50 user nova-compute[72998]: WARNING nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state deleting.
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:50 user nova-compute[72998]: WARNING nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state deleting.
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-unplugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Acquiring lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] No waiting events found dispatching network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:32:50 user nova-compute[72998]: WARNING nova.compute.manager [req-f6adfed5-9ef3-41a3-931f-7adf97eeb634 req-67900b74-8e4e-4ace-8589-51d0a74aed2a service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received unexpected event network-vif-plugged-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 for instance with vm_state active and task_state deleting.
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:32:50 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Took 1.25 seconds to deallocate network for instance.
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-acafe501-ac43-4292-b99a-28e170bea0a2 req-c157275b-ec25-4e2b-aec5-815a3b27bd0c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Received event network-vif-deleted-e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:50 user nova-compute[72998]: INFO nova.compute.manager [req-acafe501-ac43-4292-b99a-28e170bea0a2 req-c157275b-ec25-4e2b-aec5-815a3b27bd0c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Neutron deleted interface e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3; detaching it from the instance and deleting it from the info cache
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-acafe501-ac43-4292-b99a-28e170bea0a2 req-c157275b-ec25-4e2b-aec5-815a3b27bd0c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:32:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-acafe501-ac43-4292-b99a-28e170bea0a2 req-c157275b-ec25-4e2b-aec5-815a3b27bd0c service nova] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Detach interface failed, port_id=e9cd3f5a-801d-4b64-a8a8-ffffb3eea4e3, reason: Instance 4119f28a-b9f1-4996-a144-68edd4f08c44 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:32:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:32:51 user nova-compute[72998]: INFO nova.compute.manager [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] instance snapshotting
Aug 17 08:32:51 user nova-compute[72998]: INFO nova.compute.manager [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Took 0.79 seconds to detach 1 volumes for instance.
Aug 17 08:32:51 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Beginning live snapshot process
Aug 17 08:32:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json -f qcow2 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json -f qcow2" returned: 0 in 0.223s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json -f qcow2 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:52 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Deleted allocations for instance 4119f28a-b9f1-4996-a144-68edd4f08c44
Aug 17 08:32:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json -f qcow2" returned: 0 in 0.272s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-31d0bec1-dcd1-4b15-8beb-17c92e31e994 tempest-ServerActionsTestOtherB-1997511094 tempest-ServerActionsTestOtherB-1997511094-project-member] Lock "4119f28a-b9f1-4996-a144-68edd4f08c44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.231s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy345yidp/7d31012becbf46a99c908bc5498d733b.delta 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy345yidp/7d31012becbf46a99c908bc5498d733b.delta 1073741824" returned: 0 in 0.057s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 08:32:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:32:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72998) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 08:32:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 08:32:53 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:32:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy345yidp/7d31012becbf46a99c908bc5498d733b.delta /opt/stack/data/nova/instances/snapshots/tmpy345yidp/7d31012becbf46a99c908bc5498d733b {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy345yidp/7d31012becbf46a99c908bc5498d733b.delta /opt/stack/data/nova/instances/snapshots/tmpy345yidp/7d31012becbf46a99c908bc5498d733b" returned: 0 in 0.400s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:54 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Snapshot extracted, beginning image upload
Aug 17 08:32:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquiring lock "13485771-8264-445b-9a87-d8ae6c5f5059" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "13485771-8264-445b-9a87-d8ae6c5f5059" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:32:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Snapshot image upload complete
Aug 17 08:32:56 user nova-compute[72998]: INFO nova.compute.manager [None req-e21f7b13-2a4f-4744-9ff7-a8763dd47ef2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Took 5.43 seconds to snapshot the instance on the hypervisor.
Aug 17 08:32:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:32:56 user nova-compute[72998]: INFO nova.compute.claims [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Claim successful on node user
Aug 17 08:32:57 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:32:57 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:32:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG nova.policy [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df283a3a7ba64882abbe14968974753e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eedc56886624f8eb4d1a04425dd8241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:32:57 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Creating image(s)
Aug 17 08:32:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquiring lock "/opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "/opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "/opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.196s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk 1073741824" returned: 0 in 0.077s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Successfully created port: deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Cannot resize image /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lazy-loading 'migration_context' on Instance uuid 13485771-8264-445b-9a87-d8ae6c5f5059 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Ensure instance console log exists: /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:32:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:32:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:32:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Successfully updated port: deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:32:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquiring lock "refresh_cache-13485771-8264-445b-9a87-d8ae6c5f5059" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:32:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquired lock "refresh_cache-13485771-8264-445b-9a87-d8ae6c5f5059" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:32:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:32:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-0564a931-9e2a-410c-aaa4-8a01537010d3 req-bf5d1599-8da6-4cfe-97c4-d15b0702c620 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received event network-changed-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:32:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-0564a931-9e2a-410c-aaa4-8a01537010d3 req-bf5d1599-8da6-4cfe-97c4-d15b0702c620 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Refreshing instance network info cache due to event network-changed-deefbde5-35a7-493b-a5e4-01ecda913094. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:32:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0564a931-9e2a-410c-aaa4-8a01537010d3 req-bf5d1599-8da6-4cfe-97c4-d15b0702c620 service nova] Acquiring lock "refresh_cache-13485771-8264-445b-9a87-d8ae6c5f5059" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:32:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Updating instance_info_cache with network_info: [{"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Releasing lock "refresh_cache-13485771-8264-445b-9a87-d8ae6c5f5059" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Instance network_info: |[{"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0564a931-9e2a-410c-aaa4-8a01537010d3 req-bf5d1599-8da6-4cfe-97c4-d15b0702c620 service nova] Acquired lock "refresh_cache-13485771-8264-445b-9a87-d8ae6c5f5059" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-0564a931-9e2a-410c-aaa4-8a01537010d3 req-bf5d1599-8da6-4cfe-97c4-d15b0702c620 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Refreshing network info cache for port deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Start _get_guest_xml network_info=[{"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:33:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:33:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-150586897',display_name='tempest-VolumesNegativeTest-instance-150586897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-150586897',id=32,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eedc56886624f8eb4d1a04425dd8241',ramdisk_id='',reservation_id='r-s74yv0vl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1181903025',owner_user_name='tempest-VolumesNegativeTest-1181903025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:32:58Z,user_data=None,user_id='df283a3a7ba64882abbe14968974753e',uuid=13485771-8264-445b-9a87-d8ae6c5f5059,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Converting VIF {"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=deefbde5-35a7-493b-a5e4-01ecda913094,network=Network(1327b4d4-0ee7-4c02-a388-d34c4e1c01dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeefbde5-35') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lazy-loading 'pci_devices' on Instance uuid 13485771-8264-445b-9a87-d8ae6c5f5059 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:33:00 user nova-compute[72998]:   <uuid>13485771-8264-445b-9a87-d8ae6c5f5059</uuid>
Aug 17 08:33:00 user nova-compute[72998]:   <name>instance-00000020</name>
Aug 17 08:33:00 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:33:00 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:33:00 user nova-compute[72998]:   <metadata>
Aug 17 08:33:00 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:33:00 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:33:00 user nova-compute[72998]:       <nova:name>tempest-VolumesNegativeTest-instance-150586897</nova:name>
Aug 17 08:33:00 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:33:00</nova:creationTime>
Aug 17 08:33:00 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:33:00 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:33:00 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:33:00 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:33:00 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:33:00 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:33:00 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:33:00 user nova-compute[72998]:       <nova:owner>
Aug 17 08:33:00 user nova-compute[72998]:         <nova:user uuid="df283a3a7ba64882abbe14968974753e">tempest-VolumesNegativeTest-1181903025-project-member</nova:user>
Aug 17 08:33:00 user nova-compute[72998]:         <nova:project uuid="0eedc56886624f8eb4d1a04425dd8241">tempest-VolumesNegativeTest-1181903025</nova:project>
Aug 17 08:33:00 user nova-compute[72998]:       </nova:owner>
Aug 17 08:33:00 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:33:00 user nova-compute[72998]:       <nova:ports>
Aug 17 08:33:00 user nova-compute[72998]:         <nova:port uuid="deefbde5-35a7-493b-a5e4-01ecda913094">
Aug 17 08:33:00 user nova-compute[72998]:           <nova:ip type="fixed" address="192.168.233.66" ipVersion="4"/>
Aug 17 08:33:00 user nova-compute[72998]:         </nova:port>
Aug 17 08:33:00 user nova-compute[72998]:       </nova:ports>
Aug 17 08:33:00 user nova-compute[72998]:     </nova:instance>
Aug 17 08:33:00 user nova-compute[72998]:   </metadata>
Aug 17 08:33:00 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:33:00 user nova-compute[72998]:     <system>
Aug 17 08:33:00 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:33:00 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:33:00 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:33:00 user nova-compute[72998]:       <entry name="serial">13485771-8264-445b-9a87-d8ae6c5f5059</entry>
Aug 17 08:33:00 user nova-compute[72998]:       <entry name="uuid">13485771-8264-445b-9a87-d8ae6c5f5059</entry>
Aug 17 08:33:00 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:33:00 user nova-compute[72998]:     </system>
Aug 17 08:33:00 user nova-compute[72998]:   </sysinfo>
Aug 17 08:33:00 user nova-compute[72998]:   <os>
Aug 17 08:33:00 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:33:00 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:33:00 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:33:00 user nova-compute[72998]:   </os>
Aug 17 08:33:00 user nova-compute[72998]:   <features>
Aug 17 08:33:00 user nova-compute[72998]:     <acpi/>
Aug 17 08:33:00 user nova-compute[72998]:     <apic/>
Aug 17 08:33:00 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:33:00 user nova-compute[72998]:   </features>
Aug 17 08:33:00 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:33:00 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:33:00 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:33:00 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:33:00 user nova-compute[72998]:   </clock>
Aug 17 08:33:00 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:33:00 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:33:00 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:33:00 user nova-compute[72998]:   </cpu>
Aug 17 08:33:00 user nova-compute[72998]:   <devices>
Aug 17 08:33:00 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:33:00 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:33:00 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk"/>
Aug 17 08:33:00 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:33:00 user nova-compute[72998]:     </disk>
Aug 17 08:33:00 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:33:00 user nova-compute[72998]:       <mac address="fa:16:3e:9d:e7:94"/>
Aug 17 08:33:00 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:33:00 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:33:00 user nova-compute[72998]:       <target dev="tapdeefbde5-35"/>
Aug 17 08:33:00 user nova-compute[72998]:     </interface>
Aug 17 08:33:00 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:33:00 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/console.log" append="off"/>
Aug 17 08:33:00 user nova-compute[72998]:     </serial>
Aug 17 08:33:00 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:33:00 user nova-compute[72998]:     <video>
Aug 17 08:33:00 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:33:00 user nova-compute[72998]:     </video>
Aug 17 08:33:00 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:33:00 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:33:00 user nova-compute[72998]:     </rng>
Aug 17 08:33:00 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:33:00 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:33:00 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:33:00 user nova-compute[72998]:     </memballoon>
Aug 17 08:33:00 user nova-compute[72998]:   </devices>
Aug 17 08:33:00 user nova-compute[72998]: </domain>
Aug 17 08:33:00 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-150586897',display_name='tempest-VolumesNegativeTest-instance-150586897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-150586897',id=32,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eedc56886624f8eb4d1a04425dd8241',ramdisk_id='',reservation_id='r-s74yv0vl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1181903025',owner_user_name='tempest-VolumesNegativeTest-1181903025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:32:58Z,user_data=None,user_id='df283a3a7ba64882abbe14968974753e',uuid=13485771-8264-445b-9a87-d8ae6c5f5059,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Converting VIF {"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=deefbde5-35a7-493b-a5e4-01ecda913094,network=Network(1327b4d4-0ee7-4c02-a388-d34c4e1c01dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeefbde5-35') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG os_vif [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=deefbde5-35a7-493b-a5e4-01ecda913094,network=Network(1327b4d4-0ee7-4c02-a388-d34c4e1c01dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeefbde5-35') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeefbde5-35, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdeefbde5-35, col_values=(('external_ids', {'iface-id': 'deefbde5-35a7-493b-a5e4-01ecda913094', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:e7:94', 'vm-uuid': '13485771-8264-445b-9a87-d8ae6c5f5059'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:00 user nova-compute[72998]: INFO os_vif [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=deefbde5-35a7-493b-a5e4-01ecda913094,network=Network(1327b4d4-0ee7-4c02-a388-d34c4e1c01dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeefbde5-35')
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] No VIF found with MAC fa:16:3e:9d:e7:94, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-0564a931-9e2a-410c-aaa4-8a01537010d3 req-bf5d1599-8da6-4cfe-97c4-d15b0702c620 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Updated VIF entry in instance network info cache for port deefbde5-35a7-493b-a5e4-01ecda913094. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-0564a931-9e2a-410c-aaa4-8a01537010d3 req-bf5d1599-8da6-4cfe-97c4-d15b0702c620 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Updating instance_info_cache with network_info: [{"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:33:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0564a931-9e2a-410c-aaa4-8a01537010d3 req-bf5d1599-8da6-4cfe-97c4-d15b0702c620 service nova] Releasing lock "refresh_cache-13485771-8264-445b-9a87-d8ae6c5f5059" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:01 user nova-compute[72998]: DEBUG nova.compute.manager [req-c8cd1db8-69ad-4e0a-b264-8d4470a2ae98 req-9fa84bb3-c7b6-4a22-a6c4-3f8c7c7e6f55 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received event network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:33:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c8cd1db8-69ad-4e0a-b264-8d4470a2ae98 req-9fa84bb3-c7b6-4a22-a6c4-3f8c7c7e6f55 service nova] Acquiring lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:33:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c8cd1db8-69ad-4e0a-b264-8d4470a2ae98 req-9fa84bb3-c7b6-4a22-a6c4-3f8c7c7e6f55 service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:33:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c8cd1db8-69ad-4e0a-b264-8d4470a2ae98 req-9fa84bb3-c7b6-4a22-a6c4-3f8c7c7e6f55 service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:01 user nova-compute[72998]: DEBUG nova.compute.manager [req-c8cd1db8-69ad-4e0a-b264-8d4470a2ae98 req-9fa84bb3-c7b6-4a22-a6c4-3f8c7c7e6f55 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] No waiting events found dispatching network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:33:01 user nova-compute[72998]: WARNING nova.compute.manager [req-c8cd1db8-69ad-4e0a-b264-8d4470a2ae98 req-9fa84bb3-c7b6-4a22-a6c4-3f8c7c7e6f55 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received unexpected event network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 for instance with vm_state building and task_state spawning.
Aug 17 08:33:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261183.8246653, 13485771-8264-445b-9a87-d8ae6c5f5059 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:33:03 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] VM Resumed (Lifecycle Event)
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:33:03 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Instance spawned successfully.
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:33:03 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261183.8266242, 13485771-8264-445b-9a87-d8ae6c5f5059 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:33:03 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] VM Started (Lifecycle Event)
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:33:03 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-6f9313f7-fc7e-4b9d-958f-d795e541e123 req-aee31079-800e-4903-ae84-713bf3b17d6f service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received event network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6f9313f7-fc7e-4b9d-958f-d795e541e123 req-aee31079-800e-4903-ae84-713bf3b17d6f service nova] Acquiring lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6f9313f7-fc7e-4b9d-958f-d795e541e123 req-aee31079-800e-4903-ae84-713bf3b17d6f service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6f9313f7-fc7e-4b9d-958f-d795e541e123 req-aee31079-800e-4903-ae84-713bf3b17d6f service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-6f9313f7-fc7e-4b9d-958f-d795e541e123 req-aee31079-800e-4903-ae84-713bf3b17d6f service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] No waiting events found dispatching network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:33:03 user nova-compute[72998]: WARNING nova.compute.manager [req-6f9313f7-fc7e-4b9d-958f-d795e541e123 req-aee31079-800e-4903-ae84-713bf3b17d6f service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received unexpected event network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 for instance with vm_state building and task_state spawning.
Aug 17 08:33:03 user nova-compute[72998]: INFO nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:33:03 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261168.9778917, 4119f28a-b9f1-4996-a144-68edd4f08c44 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:33:03 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] VM Stopped (Lifecycle Event)
Aug 17 08:33:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2a7da8ad-a9bd-484b-a626-79512828f6e2 None None] [instance: 4119f28a-b9f1-4996-a144-68edd4f08c44] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:33:04 user nova-compute[72998]: INFO nova.compute.manager [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Took 7.11 seconds to build instance.
Aug 17 08:33:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f64a57bd-d86f-4e4c-bde3-d910f91d0e5f tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "13485771-8264-445b-9a87-d8ae6c5f5059" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.234s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:33:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:33:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:33:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:33:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:33:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:33:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:33:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:33:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:33:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:33:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:33:16 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:33:16 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7879MB free_disk=24.06885528564453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 13485771-8264-445b-9a87-d8ae6c5f5059 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:33:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:33:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:33:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:33:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:33:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:33:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:33:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:33:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:24 user nova-compute[72998]: INFO nova.compute.manager [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Terminating instance
Aug 17 08:33:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-76bdc435-9002-4e3b-b8d1-4d07d8c1d26f req-2d8359c2-253b-4ec4-84f5-8c1a85bad679 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received event network-vif-unplugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-76bdc435-9002-4e3b-b8d1-4d07d8c1d26f req-2d8359c2-253b-4ec4-84f5-8c1a85bad679 service nova] Acquiring lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-76bdc435-9002-4e3b-b8d1-4d07d8c1d26f req-2d8359c2-253b-4ec4-84f5-8c1a85bad679 service nova] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-76bdc435-9002-4e3b-b8d1-4d07d8c1d26f req-2d8359c2-253b-4ec4-84f5-8c1a85bad679 service nova] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-76bdc435-9002-4e3b-b8d1-4d07d8c1d26f req-2d8359c2-253b-4ec4-84f5-8c1a85bad679 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] No waiting events found dispatching network-vif-unplugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-76bdc435-9002-4e3b-b8d1-4d07d8c1d26f req-2d8359c2-253b-4ec4-84f5-8c1a85bad679 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received event network-vif-unplugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Instance destroyed successfully.
Aug 17 08:33:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lazy-loading 'resources' on Instance uuid e2b811f8-19a3-4b50-8ea9-6d3442c38819 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1603069519',display_name='tempest-ServerActionsTestOtherA-server-1603069519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1603069519',id=1,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwso8zXzyr8rdW+F3TIWTcGQW2195HR8rtDbyl+3RZbz4rT8sA0T1Nq594b2NMeWJ/ZCBUqUIDbRSEtao2k3JmymnhZIpHBjG50mdl6hk0l6mAeujcqHjcduFAXBAHWg==',key_name='tempest-keypair-622925506',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d62167eb6909402f8dca89678acff055',ramdisk_id='',reservation_id='r-gq796j7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1892042619',owner_user_name='tempest-ServerActionsTestOtherA-1892042619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:14:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be579ee85cb4ac2b59812bbee48c272',uuid=e2b811f8-19a3-4b50-8ea9-6d3442c38819,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converting VIF {"id": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "address": "fa:16:3e:eb:93:15", "network": {"id": "f7eee779-104e-46fa-ad9d-afa4837c54dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-365291349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d62167eb6909402f8dca89678acff055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcaef72a-ce", "ovs_interfaceid": "fcaef72a-ce0c-491a-a108-1b7a74c5c58e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:93:15,bridge_name='br-int',has_traffic_filtering=True,id=fcaef72a-ce0c-491a-a108-1b7a74c5c58e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcaef72a-ce') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG os_vif [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:93:15,bridge_name='br-int',has_traffic_filtering=True,id=fcaef72a-ce0c-491a-a108-1b7a74c5c58e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcaef72a-ce') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcaef72a-ce, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:33:25 user nova-compute[72998]: INFO os_vif [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:93:15,bridge_name='br-int',has_traffic_filtering=True,id=fcaef72a-ce0c-491a-a108-1b7a74c5c58e,network=Network(f7eee779-104e-46fa-ad9d-afa4837c54dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcaef72a-ce')
Aug 17 08:33:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Deleting instance files /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819_del
Aug 17 08:33:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Deletion of /opt/stack/data/nova/instances/e2b811f8-19a3-4b50-8ea9-6d3442c38819_del complete
Aug 17 08:33:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:25 user nova-compute[72998]: INFO nova.compute.manager [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 08:33:25 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:33:25 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:33:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:26 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:33:26 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Took 0.60 seconds to deallocate network for instance.
Aug 17 08:33:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-c40beaca-e253-4a5e-b774-d2521d8ca184 req-fbae39fb-9686-4547-a0b7-19fd5dd74df3 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received event network-vif-deleted-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:33:26 user nova-compute[72998]: INFO nova.compute.manager [req-c40beaca-e253-4a5e-b774-d2521d8ca184 req-fbae39fb-9686-4547-a0b7-19fd5dd74df3 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Neutron deleted interface fcaef72a-ce0c-491a-a108-1b7a74c5c58e; detaching it from the instance and deleting it from the info cache
Aug 17 08:33:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-c40beaca-e253-4a5e-b774-d2521d8ca184 req-fbae39fb-9686-4547-a0b7-19fd5dd74df3 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:33:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-c40beaca-e253-4a5e-b774-d2521d8ca184 req-fbae39fb-9686-4547-a0b7-19fd5dd74df3 service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Detach interface failed, port_id=fcaef72a-ce0c-491a-a108-1b7a74c5c58e, reason: Instance e2b811f8-19a3-4b50-8ea9-6d3442c38819 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:33:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:33:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:33:26 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:33:26 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:33:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:26 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Deleted allocations for instance e2b811f8-19a3-4b50-8ea9-6d3442c38819
Aug 17 08:33:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-95ffda8e-09c1-4583-b5ba-c7ac5cdab5c4 tempest-ServerActionsTestOtherA-1892042619 tempest-ServerActionsTestOtherA-1892042619-project-member] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-6f4b1b52-eafc-4e88-aab4-27d0a8555598 req-aacf9118-c436-46a2-9164-7ab8080b33fd service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received event network-vif-plugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:33:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6f4b1b52-eafc-4e88-aab4-27d0a8555598 req-aacf9118-c436-46a2-9164-7ab8080b33fd service nova] Acquiring lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:33:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6f4b1b52-eafc-4e88-aab4-27d0a8555598 req-aacf9118-c436-46a2-9164-7ab8080b33fd service nova] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:33:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6f4b1b52-eafc-4e88-aab4-27d0a8555598 req-aacf9118-c436-46a2-9164-7ab8080b33fd service nova] Lock "e2b811f8-19a3-4b50-8ea9-6d3442c38819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:33:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-6f4b1b52-eafc-4e88-aab4-27d0a8555598 req-aacf9118-c436-46a2-9164-7ab8080b33fd service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] No waiting events found dispatching network-vif-plugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:33:27 user nova-compute[72998]: WARNING nova.compute.manager [req-6f4b1b52-eafc-4e88-aab4-27d0a8555598 req-aacf9118-c436-46a2-9164-7ab8080b33fd service nova] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Received unexpected event network-vif-plugged-fcaef72a-ce0c-491a-a108-1b7a74c5c58e for instance with vm_state deleted and task_state None.
Aug 17 08:33:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:40 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261205.4837446, e2b811f8-19a3-4b50-8ea9-6d3442c38819 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:33:40 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] VM Stopped (Lifecycle Event)
Aug 17 08:33:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8346c238-bdf7-4712-994f-4de4d35e98ed None None] [instance: e2b811f8-19a3-4b50-8ea9-6d3442c38819] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:33:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:33:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:33:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d6089253-9a85-4d00-82f9-950660857b54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:34:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:34:00 user nova-compute[72998]: INFO nova.compute.claims [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Claim successful on node user
Aug 17 08:34:00 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:34:01 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:34:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:34:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:34:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:34:01 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:34:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:34:01 user nova-compute[72998]: INFO nova.virt.block_device [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Booting with volume-backed-image 2fbaeab0-5441-4c6d-b8e6-2fab61f67348 at /dev/vda
Aug 17 08:34:01 user nova-compute[72998]: DEBUG nova.policy [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf94d9d63f9e4e5a9d0a4f175fddff16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef0a0f5a7b6484483231263041317df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Successfully created port: c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:02 user nova-compute[72998]: INFO nova.compute.manager [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Terminating instance
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-d2d9458d-d452-43a4-8e27-06b84403dc8a req-3469c94e-80e3-4310-84a3-85e418185b99 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-unplugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d2d9458d-d452-43a4-8e27-06b84403dc8a req-3469c94e-80e3-4310-84a3-85e418185b99 service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d2d9458d-d452-43a4-8e27-06b84403dc8a req-3469c94e-80e3-4310-84a3-85e418185b99 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d2d9458d-d452-43a4-8e27-06b84403dc8a req-3469c94e-80e3-4310-84a3-85e418185b99 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-d2d9458d-d452-43a4-8e27-06b84403dc8a req-3469c94e-80e3-4310-84a3-85e418185b99 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-unplugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-d2d9458d-d452-43a4-8e27-06b84403dc8a req-3469c94e-80e3-4310-84a3-85e418185b99 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-unplugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:34:02 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Instance destroyed successfully.
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'resources' on Instance uuid 87850ffb-dfa9-4b23-bd18-938744cd9b5f {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Successfully updated port: c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1003522619',display_name='tempest-AttachVolumeTestJSON-server-1003522619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1003522619',id=22,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmc8qbkgbu95dJvwY1bo5kn9RJpsYoyrns3+CWvhffMSTP6KyY1SbvmOYfexUjDzD3737D3c8fhHlVWQh2nyWElT5uU1HwkwSVrOW/xi1hx6Ymm9am4ZS8Qy8EFRomqnw==',key_name='tempest-keypair-346425477',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-h31cebic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:32:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=87850ffb-dfa9-4b23-bd18-938744cd9b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "85901016-fa8e-4d52-9229-caa63c02bea3", "address": "fa:16:3e:9c:31:a6", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85901016-fa", "ovs_interfaceid": "85901016-fa8e-4d52-9229-caa63c02bea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:34:02 user nova-compute[72998]: DEBUG os_vif [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquired lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85901016-fa, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:34:03 user nova-compute[72998]: INFO os_vif [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:31:a6,bridge_name='br-int',has_traffic_filtering=True,id=85901016-fa8e-4d52-9229-caa63c02bea3,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85901016-fa')
Aug 17 08:34:03 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Deleting instance files /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f_del
Aug 17 08:34:03 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Deletion of /opt/stack/data/nova/instances/87850ffb-dfa9-4b23-bd18-938744cd9b5f_del complete
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-35c2d80e-73cb-4589-a07e-4288fff673bb req-acedd43a-c4dc-4ae3-8710-56e68b348764 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-changed-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-35c2d80e-73cb-4589-a07e-4288fff673bb req-acedd43a-c4dc-4ae3-8710-56e68b348764 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Refreshing instance network info cache due to event network-changed-c5e8bfc2-5587-4650-a5d0-af67de1044bb. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-35c2d80e-73cb-4589-a07e-4288fff673bb req-acedd43a-c4dc-4ae3-8710-56e68b348764 service nova] Acquiring lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:34:03 user nova-compute[72998]: INFO nova.compute.manager [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 08:34:03 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Updating instance_info_cache with network_info: [{"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Releasing lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Instance network_info: |[{"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-35c2d80e-73cb-4589-a07e-4288fff673bb req-acedd43a-c4dc-4ae3-8710-56e68b348764 service nova] Acquired lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.network.neutron [req-35c2d80e-73cb-4589-a07e-4288fff673bb req-acedd43a-c4dc-4ae3-8710-56e68b348764 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Refreshing network info cache for port c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:03 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Took 0.79 seconds to deallocate network for instance.
Aug 17 08:34:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.network.neutron [req-35c2d80e-73cb-4589-a07e-4288fff673bb req-acedd43a-c4dc-4ae3-8710-56e68b348764 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Updated VIF entry in instance network info cache for port c5e8bfc2-5587-4650-a5d0-af67de1044bb. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG nova.network.neutron [req-35c2d80e-73cb-4589-a07e-4288fff673bb req-acedd43a-c4dc-4ae3-8710-56e68b348764 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Updating instance_info_cache with network_info: [{"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-35c2d80e-73cb-4589-a07e-4288fff673bb req-acedd43a-c4dc-4ae3-8710-56e68b348764 service nova] Releasing lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:34:04 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:34:04 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:34:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:04 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Deleted allocations for instance 87850ffb-dfa9-4b23-bd18-938744cd9b5f
Aug 17 08:34:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7dd70172-aa5f-4ace-b3b0-40342f0d3a84 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-a1fe801a-40d0-4229-be7a-5304463f880b req-278e7417-7404-4bf7-b75f-8c85cb269b28 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a1fe801a-40d0-4229-be7a-5304463f880b req-278e7417-7404-4bf7-b75f-8c85cb269b28 service nova] Acquiring lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a1fe801a-40d0-4229-be7a-5304463f880b req-278e7417-7404-4bf7-b75f-8c85cb269b28 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a1fe801a-40d0-4229-be7a-5304463f880b req-278e7417-7404-4bf7-b75f-8c85cb269b28 service nova] Lock "87850ffb-dfa9-4b23-bd18-938744cd9b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-a1fe801a-40d0-4229-be7a-5304463f880b req-278e7417-7404-4bf7-b75f-8c85cb269b28 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] No waiting events found dispatching network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:34:04 user nova-compute[72998]: WARNING nova.compute.manager [req-a1fe801a-40d0-4229-be7a-5304463f880b req-278e7417-7404-4bf7-b75f-8c85cb269b28 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received unexpected event network-vif-plugged-85901016-fa8e-4d52-9229-caa63c02bea3 for instance with vm_state deleted and task_state None.
Aug 17 08:34:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-a1fe801a-40d0-4229-be7a-5304463f880b req-278e7417-7404-4bf7-b75f-8c85cb269b28 service nova] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Received event network-vif-deleted-85901016-fa8e-4d52-9229-caa63c02bea3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:34:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:34:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Skipping network cache update for instance because it is Building. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 08:34:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:34:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:34:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:34:07 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:34:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updating instance_info_cache with network_info: [{"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:34:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG os_brick.utils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df37c19-7f55-4887-b3e9-fc8408016494]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5e113f-3c98-49e5-9c20-dcd80ba2bd0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[03646bce-2269-40ea-b1d2-eab8536f1609]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf75657-a899-4893-8633-f102355eb99f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:34:12 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b1c7de-452f-4644-b1fa-2668719d5644]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG os_brick.utils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Updating existing volume attachment record: 0dcdfe5f-76bf-41c5-805b-e1f16941cd84 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:34:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:34:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:13 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:34:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:16 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:34:16 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8203MB free_disk=24.084915161132812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 13485771-8264-445b-9a87-d8ae6c5f5059 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d6089253-9a85-4d00-82f9-950660857b54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:34:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:17 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261242.9705882, 87850ffb-dfa9-4b23-bd18-938744cd9b5f => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:34:17 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] VM Stopped (Lifecycle Event)
Aug 17 08:34:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-87ccafb7-85ff-4eeb-b17a-c877de8f9885 None None] [instance: 87850ffb-dfa9-4b23-bd18-938744cd9b5f] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:34:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:34:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:34:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:34:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:34:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:20 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:34:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "8c162466-8bc9-467d-955b-0ab0c4aa5693" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:34:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:34:23 user nova-compute[72998]: INFO nova.compute.claims [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Claim successful on node user
Aug 17 08:34:24 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:34:24 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:34:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG nova.policy [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f38547b6181642c8b51ff26c5cece96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cd55d2a46440109d871d95b275ee35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:34:24 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Creating image(s)
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "/opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "/opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.197s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.196s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk 1073741824" returned: 0 in 0.054s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Cannot resize image /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lazy-loading 'migration_context' on Instance uuid 8c162466-8bc9-467d-955b-0ab0c4aa5693 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Ensure instance console log exists: /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:26 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Successfully created port: 42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:34:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Successfully updated port: 42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:34:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "refresh_cache-8c162466-8bc9-467d-955b-0ab0c4aa5693" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:34:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquired lock "refresh_cache-8c162466-8bc9-467d-955b-0ab0c4aa5693" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:34:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:34:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-1b0b2b44-20b6-4445-964b-1c4fed4dd34b req-cfb515e2-2f78-4fbd-af2c-4165af482d32 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received event network-changed-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-1b0b2b44-20b6-4445-964b-1c4fed4dd34b req-cfb515e2-2f78-4fbd-af2c-4165af482d32 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Refreshing instance network info cache due to event network-changed-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:34:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1b0b2b44-20b6-4445-964b-1c4fed4dd34b req-cfb515e2-2f78-4fbd-af2c-4165af482d32 service nova] Acquiring lock "refresh_cache-8c162466-8bc9-467d-955b-0ab0c4aa5693" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:34:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Updating instance_info_cache with network_info: [{"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Releasing lock "refresh_cache-8c162466-8bc9-467d-955b-0ab0c4aa5693" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Instance network_info: |[{"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1b0b2b44-20b6-4445-964b-1c4fed4dd34b req-cfb515e2-2f78-4fbd-af2c-4165af482d32 service nova] Acquired lock "refresh_cache-8c162466-8bc9-467d-955b-0ab0c4aa5693" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.network.neutron [req-1b0b2b44-20b6-4445-964b-1c4fed4dd34b req-cfb515e2-2f78-4fbd-af2c-4165af482d32 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Refreshing network info cache for port 42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Start _get_guest_xml network_info=[{"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:34:28 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:34:28 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1490360562',display_name='tempest-ServersNegativeTestJSON-server-1490360562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1490360562',id=34,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80cd55d2a46440109d871d95b275ee35',ramdisk_id='',reservation_id='r-q8xamabf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-767382591',owner_user_name='tempest-ServersNegativeTestJSON-767382591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:34:25Z,user_data=None,user_id='f38547b6181642c8b51ff26c5cece96a',uuid=8c162466-8bc9-467d-955b-0ab0c4aa5693,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converting VIF {"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:df:84,bridge_name='br-int',has_traffic_filtering=True,id=42a8fe95-dab5-4fe8-a3c0-948e77ad9d86,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a8fe95-da') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c162466-8bc9-467d-955b-0ab0c4aa5693 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:34:28 user nova-compute[72998]:   <uuid>8c162466-8bc9-467d-955b-0ab0c4aa5693</uuid>
Aug 17 08:34:28 user nova-compute[72998]:   <name>instance-00000022</name>
Aug 17 08:34:28 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:34:28 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:34:28 user nova-compute[72998]:   <metadata>
Aug 17 08:34:28 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:34:28 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:34:28 user nova-compute[72998]:       <nova:name>tempest-ServersNegativeTestJSON-server-1490360562</nova:name>
Aug 17 08:34:28 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:34:28</nova:creationTime>
Aug 17 08:34:28 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:34:28 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:34:28 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:34:28 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:34:28 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:34:28 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:34:28 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:34:28 user nova-compute[72998]:       <nova:owner>
Aug 17 08:34:28 user nova-compute[72998]:         <nova:user uuid="f38547b6181642c8b51ff26c5cece96a">tempest-ServersNegativeTestJSON-767382591-project-member</nova:user>
Aug 17 08:34:28 user nova-compute[72998]:         <nova:project uuid="80cd55d2a46440109d871d95b275ee35">tempest-ServersNegativeTestJSON-767382591</nova:project>
Aug 17 08:34:28 user nova-compute[72998]:       </nova:owner>
Aug 17 08:34:28 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:34:28 user nova-compute[72998]:       <nova:ports>
Aug 17 08:34:28 user nova-compute[72998]:         <nova:port uuid="42a8fe95-dab5-4fe8-a3c0-948e77ad9d86">
Aug 17 08:34:28 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 08:34:28 user nova-compute[72998]:         </nova:port>
Aug 17 08:34:28 user nova-compute[72998]:       </nova:ports>
Aug 17 08:34:28 user nova-compute[72998]:     </nova:instance>
Aug 17 08:34:28 user nova-compute[72998]:   </metadata>
Aug 17 08:34:28 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:34:28 user nova-compute[72998]:     <system>
Aug 17 08:34:28 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:34:28 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:34:28 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:34:28 user nova-compute[72998]:       <entry name="serial">8c162466-8bc9-467d-955b-0ab0c4aa5693</entry>
Aug 17 08:34:28 user nova-compute[72998]:       <entry name="uuid">8c162466-8bc9-467d-955b-0ab0c4aa5693</entry>
Aug 17 08:34:28 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:34:28 user nova-compute[72998]:     </system>
Aug 17 08:34:28 user nova-compute[72998]:   </sysinfo>
Aug 17 08:34:28 user nova-compute[72998]:   <os>
Aug 17 08:34:28 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:34:28 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:34:28 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:34:28 user nova-compute[72998]:   </os>
Aug 17 08:34:28 user nova-compute[72998]:   <features>
Aug 17 08:34:28 user nova-compute[72998]:     <acpi/>
Aug 17 08:34:28 user nova-compute[72998]:     <apic/>
Aug 17 08:34:28 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:34:28 user nova-compute[72998]:   </features>
Aug 17 08:34:28 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:34:28 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:34:28 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:34:28 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:34:28 user nova-compute[72998]:   </clock>
Aug 17 08:34:28 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:34:28 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:34:28 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:34:28 user nova-compute[72998]:   </cpu>
Aug 17 08:34:28 user nova-compute[72998]:   <devices>
Aug 17 08:34:28 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:34:28 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:34:28 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk"/>
Aug 17 08:34:28 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:34:28 user nova-compute[72998]:     </disk>
Aug 17 08:34:28 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:34:28 user nova-compute[72998]:       <mac address="fa:16:3e:7a:df:84"/>
Aug 17 08:34:28 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:34:28 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:34:28 user nova-compute[72998]:       <target dev="tap42a8fe95-da"/>
Aug 17 08:34:28 user nova-compute[72998]:     </interface>
Aug 17 08:34:28 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:34:28 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/console.log" append="off"/>
Aug 17 08:34:28 user nova-compute[72998]:     </serial>
Aug 17 08:34:28 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:34:28 user nova-compute[72998]:     <video>
Aug 17 08:34:28 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:34:28 user nova-compute[72998]:     </video>
Aug 17 08:34:28 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:34:28 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:34:28 user nova-compute[72998]:     </rng>
Aug 17 08:34:28 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:34:28 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:34:28 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:34:28 user nova-compute[72998]:     </memballoon>
Aug 17 08:34:28 user nova-compute[72998]:   </devices>
Aug 17 08:34:28 user nova-compute[72998]: </domain>
Aug 17 08:34:28 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1490360562',display_name='tempest-ServersNegativeTestJSON-server-1490360562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1490360562',id=34,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80cd55d2a46440109d871d95b275ee35',ramdisk_id='',reservation_id='r-q8xamabf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-767382591',owner_user_name='tempest-ServersNegativeTestJSON-767382591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:34:25Z,user_data=None,user_id='f38547b6181642c8b51ff26c5cece96a',uuid=8c162466-8bc9-467d-955b-0ab0c4aa5693,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converting VIF {"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:df:84,bridge_name='br-int',has_traffic_filtering=True,id=42a8fe95-dab5-4fe8-a3c0-948e77ad9d86,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a8fe95-da') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG os_vif [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:df:84,bridge_name='br-int',has_traffic_filtering=True,id=42a8fe95-dab5-4fe8-a3c0-948e77ad9d86,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a8fe95-da') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42a8fe95-da, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42a8fe95-da, col_values=(('external_ids', {'iface-id': '42a8fe95-dab5-4fe8-a3c0-948e77ad9d86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:df:84', 'vm-uuid': '8c162466-8bc9-467d-955b-0ab0c4aa5693'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:28 user nova-compute[72998]: INFO os_vif [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:df:84,bridge_name='br-int',has_traffic_filtering=True,id=42a8fe95-dab5-4fe8-a3c0-948e77ad9d86,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a8fe95-da')
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:34:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] No VIF found with MAC fa:16:3e:7a:df:84, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:34:29 user nova-compute[72998]: DEBUG nova.network.neutron [req-1b0b2b44-20b6-4445-964b-1c4fed4dd34b req-cfb515e2-2f78-4fbd-af2c-4165af482d32 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Updated VIF entry in instance network info cache for port 42a8fe95-dab5-4fe8-a3c0-948e77ad9d86. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:34:29 user nova-compute[72998]: DEBUG nova.network.neutron [req-1b0b2b44-20b6-4445-964b-1c4fed4dd34b req-cfb515e2-2f78-4fbd-af2c-4165af482d32 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Updating instance_info_cache with network_info: [{"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1b0b2b44-20b6-4445-964b-1c4fed4dd34b req-cfb515e2-2f78-4fbd-af2c-4165af482d32 service nova] Releasing lock "refresh_cache-8c162466-8bc9-467d-955b-0ab0c4aa5693" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:34:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261272.451625, 8c162466-8bc9-467d-955b-0ab0c4aa5693 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:34:32 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] VM Resumed (Lifecycle Event)
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:34:32 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Instance spawned successfully.
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:32 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261272.4528146, 8c162466-8bc9-467d-955b-0ab0c4aa5693 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:34:32 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] VM Started (Lifecycle Event)
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:34:32 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:34:32 user nova-compute[72998]: INFO nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Took 8.00 seconds to spawn the instance on the hypervisor.
Aug 17 08:34:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:34:32 user nova-compute[72998]: INFO nova.compute.manager [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Took 8.85 seconds to build instance.
Aug 17 08:34:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6bc95e57-abb4-4e21-b35f-b59b443642e1 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.044s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:34:33 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Creating image(s)
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Ensure instance console log exists: /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Start _get_guest_xml network_info=[{"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0dcdfe5f-76bf-41c5-805b-e1f16941cd84', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amhEwoqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6089253-9a85-4d00-82f9-950660857b54', 'attached_at': '', 'detached_at': '', 'volume_id': '7f919e88-0e8b-41ac-8b02-7fea832df6a3', 'serial': '7f919e88-0e8b-41ac-8b02-7fea832df6a3'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:34:33 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:34:33 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amhEwoqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:34:33 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:34:33 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:34:33 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c3ba99-2495-4cdd-bf5c-9f15a544966f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:34:33 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1815ee-6e3b-4aa4-bb51-0d8dddafe0be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3] added
Aug 17 08:34:33 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d0c5c4-f0fb-496e-80f4-6647716ed619]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1d2375-a2f8-4648-97f2-bbe2cad4fba5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amhEwoqp {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amhEwoqp" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e687ba4-981a-40d7-93ab-fa247642e101]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'amhEwoqp'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db94962-14af-49e6-ad71-cafc3293b783]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[930dc00e-9936-4937-9633-284fc77eab1d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:34:33 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:34:33 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[793234f5-6cc2-44df-819b-d313392b33f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3, portal: 172.16.0.220,3260]
Aug 17 08:34:33 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3, portal: 172.16.0.220,3260] successful.
Aug 17 08:34:33 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8a239-6de7-4056-b007-6522f7cc1da0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[32beae28-0944-45b4-85f5-6aa00897844b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:34:33 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:34:33 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:34:33 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:34:33 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e788c8-bb3d-467a-b327-6ecc2cfa1a1f]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:33 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amhEwoqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26434383832663065', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434383832663065', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1027641458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1027641458',id=33,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-3nym79wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:34:01Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=d6089253-9a85-4d00-82f9-950660857b54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:0d:43,bridge_name='br-int',has_traffic_filtering=True,id=c5e8bfc2-5587-4650-a5d0-af67de1044bb,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e8bfc2-55') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'pci_devices' on Instance uuid d6089253-9a85-4d00-82f9-950660857b54 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:34:34 user nova-compute[72998]:   <uuid>d6089253-9a85-4d00-82f9-950660857b54</uuid>
Aug 17 08:34:34 user nova-compute[72998]:   <name>instance-00000021</name>
Aug 17 08:34:34 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:34:34 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:34:34 user nova-compute[72998]:   <metadata>
Aug 17 08:34:34 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:34:34 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:34:34 user nova-compute[72998]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1027641458</nova:name>
Aug 17 08:34:34 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:34:33</nova:creationTime>
Aug 17 08:34:34 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:34:34 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:34:34 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:34:34 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:34:34 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:34:34 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:34:34 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:34:34 user nova-compute[72998]:       <nova:owner>
Aug 17 08:34:34 user nova-compute[72998]:         <nova:user uuid="cf94d9d63f9e4e5a9d0a4f175fddff16">tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member</nova:user>
Aug 17 08:34:34 user nova-compute[72998]:         <nova:project uuid="0ef0a0f5a7b6484483231263041317df">tempest-ServerBootFromVolumeStableRescueTest-1298365870</nova:project>
Aug 17 08:34:34 user nova-compute[72998]:       </nova:owner>
Aug 17 08:34:34 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:34:34 user nova-compute[72998]:       <nova:ports>
Aug 17 08:34:34 user nova-compute[72998]:         <nova:port uuid="c5e8bfc2-5587-4650-a5d0-af67de1044bb">
Aug 17 08:34:34 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 08:34:34 user nova-compute[72998]:         </nova:port>
Aug 17 08:34:34 user nova-compute[72998]:       </nova:ports>
Aug 17 08:34:34 user nova-compute[72998]:     </nova:instance>
Aug 17 08:34:34 user nova-compute[72998]:   </metadata>
Aug 17 08:34:34 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:34:34 user nova-compute[72998]:     <system>
Aug 17 08:34:34 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:34:34 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:34:34 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:34:34 user nova-compute[72998]:       <entry name="serial">d6089253-9a85-4d00-82f9-950660857b54</entry>
Aug 17 08:34:34 user nova-compute[72998]:       <entry name="uuid">d6089253-9a85-4d00-82f9-950660857b54</entry>
Aug 17 08:34:34 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:34:34 user nova-compute[72998]:     </system>
Aug 17 08:34:34 user nova-compute[72998]:   </sysinfo>
Aug 17 08:34:34 user nova-compute[72998]:   <os>
Aug 17 08:34:34 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:34:34 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:34:34 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:34:34 user nova-compute[72998]:   </os>
Aug 17 08:34:34 user nova-compute[72998]:   <features>
Aug 17 08:34:34 user nova-compute[72998]:     <acpi/>
Aug 17 08:34:34 user nova-compute[72998]:     <apic/>
Aug 17 08:34:34 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:34:34 user nova-compute[72998]:   </features>
Aug 17 08:34:34 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:34:34 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:34:34 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:34:34 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:34:34 user nova-compute[72998]:   </clock>
Aug 17 08:34:34 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:34:34 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:34:34 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:34:34 user nova-compute[72998]:   </cpu>
Aug 17 08:34:34 user nova-compute[72998]:   <devices>
Aug 17 08:34:34 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:34:34 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:34:34 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 08:34:34 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:34:34 user nova-compute[72998]:       <serial>7f919e88-0e8b-41ac-8b02-7fea832df6a3</serial>
Aug 17 08:34:34 user nova-compute[72998]:     </disk>
Aug 17 08:34:34 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:34:34 user nova-compute[72998]:       <mac address="fa:16:3e:33:0d:43"/>
Aug 17 08:34:34 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:34:34 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:34:34 user nova-compute[72998]:       <target dev="tapc5e8bfc2-55"/>
Aug 17 08:34:34 user nova-compute[72998]:     </interface>
Aug 17 08:34:34 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:34:34 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/console.log" append="off"/>
Aug 17 08:34:34 user nova-compute[72998]:     </serial>
Aug 17 08:34:34 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:34:34 user nova-compute[72998]:     <video>
Aug 17 08:34:34 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:34:34 user nova-compute[72998]:     </video>
Aug 17 08:34:34 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:34:34 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:34:34 user nova-compute[72998]:     </rng>
Aug 17 08:34:34 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:34:34 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:34:34 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:34:34 user nova-compute[72998]:     </memballoon>
Aug 17 08:34:34 user nova-compute[72998]:   </devices>
Aug 17 08:34:34 user nova-compute[72998]: </domain>
Aug 17 08:34:34 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1027641458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1027641458',id=33,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-3nym79wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:34:01Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=d6089253-9a85-4d00-82f9-950660857b54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:0d:43,bridge_name='br-int',has_traffic_filtering=True,id=c5e8bfc2-5587-4650-a5d0-af67de1044bb,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e8bfc2-55') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG os_vif [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:0d:43,bridge_name='br-int',has_traffic_filtering=True,id=c5e8bfc2-5587-4650-a5d0-af67de1044bb,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e8bfc2-55') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5e8bfc2-55, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5e8bfc2-55, col_values=(('external_ids', {'iface-id': 'c5e8bfc2-5587-4650-a5d0-af67de1044bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:0d:43', 'vm-uuid': 'd6089253-9a85-4d00-82f9-950660857b54'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:34:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:35 user nova-compute[72998]: INFO os_vif [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:0d:43,bridge_name='br-int',has_traffic_filtering=True,id=c5e8bfc2-5587-4650-a5d0-af67de1044bb,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e8bfc2-55')
Aug 17 08:34:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:34:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No VIF found with MAC fa:16:3e:33:0d:43, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-3b0a181f-c1d1-4da2-ac90-7ac9267bd469 req-32581f1a-c7c1-4ee2-beb5-308a8fb19e69 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received event network-vif-plugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3b0a181f-c1d1-4da2-ac90-7ac9267bd469 req-32581f1a-c7c1-4ee2-beb5-308a8fb19e69 service nova] Acquiring lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3b0a181f-c1d1-4da2-ac90-7ac9267bd469 req-32581f1a-c7c1-4ee2-beb5-308a8fb19e69 service nova] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3b0a181f-c1d1-4da2-ac90-7ac9267bd469 req-32581f1a-c7c1-4ee2-beb5-308a8fb19e69 service nova] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-3b0a181f-c1d1-4da2-ac90-7ac9267bd469 req-32581f1a-c7c1-4ee2-beb5-308a8fb19e69 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] No waiting events found dispatching network-vif-plugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:34:36 user nova-compute[72998]: WARNING nova.compute.manager [req-3b0a181f-c1d1-4da2-ac90-7ac9267bd469 req-32581f1a-c7c1-4ee2-beb5-308a8fb19e69 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received unexpected event network-vif-plugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 for instance with vm_state active and task_state None.
Aug 17 08:34:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-533ce8bd-bc58-4d39-85b9-fe621a531009 req-704e7ba0-c796-4c1b-b04b-f0f9f56c8170 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-533ce8bd-bc58-4d39-85b9-fe621a531009 req-704e7ba0-c796-4c1b-b04b-f0f9f56c8170 service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-533ce8bd-bc58-4d39-85b9-fe621a531009 req-704e7ba0-c796-4c1b-b04b-f0f9f56c8170 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-533ce8bd-bc58-4d39-85b9-fe621a531009 req-704e7ba0-c796-4c1b-b04b-f0f9f56c8170 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-533ce8bd-bc58-4d39-85b9-fe621a531009 req-704e7ba0-c796-4c1b-b04b-f0f9f56c8170 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:34:36 user nova-compute[72998]: WARNING nova.compute.manager [req-533ce8bd-bc58-4d39-85b9-fe621a531009 req-704e7ba0-c796-4c1b-b04b-f0f9f56c8170 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state building and task_state spawning.
Aug 17 08:34:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-f7ff0a17-8f5e-4707-82c0-6b48e4b645ba req-b03a60b1-aa66-4253-b836-fa2698526259 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received event network-vif-plugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7ff0a17-8f5e-4707-82c0-6b48e4b645ba req-b03a60b1-aa66-4253-b836-fa2698526259 service nova] Acquiring lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7ff0a17-8f5e-4707-82c0-6b48e4b645ba req-b03a60b1-aa66-4253-b836-fa2698526259 service nova] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7ff0a17-8f5e-4707-82c0-6b48e4b645ba req-b03a60b1-aa66-4253-b836-fa2698526259 service nova] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-f7ff0a17-8f5e-4707-82c0-6b48e4b645ba req-b03a60b1-aa66-4253-b836-fa2698526259 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] No waiting events found dispatching network-vif-plugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:34:38 user nova-compute[72998]: WARNING nova.compute.manager [req-f7ff0a17-8f5e-4707-82c0-6b48e4b645ba req-b03a60b1-aa66-4253-b836-fa2698526259 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received unexpected event network-vif-plugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 for instance with vm_state active and task_state None.
Aug 17 08:34:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-ea0a36b5-a236-49fc-a791-cf05c85152fe req-3378a70f-714c-48b3-966f-c5643ad71ec0 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ea0a36b5-a236-49fc-a791-cf05c85152fe req-3378a70f-714c-48b3-966f-c5643ad71ec0 service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ea0a36b5-a236-49fc-a791-cf05c85152fe req-3378a70f-714c-48b3-966f-c5643ad71ec0 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ea0a36b5-a236-49fc-a791-cf05c85152fe req-3378a70f-714c-48b3-966f-c5643ad71ec0 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-ea0a36b5-a236-49fc-a791-cf05c85152fe req-3378a70f-714c-48b3-966f-c5643ad71ec0 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:34:38 user nova-compute[72998]: WARNING nova.compute.manager [req-ea0a36b5-a236-49fc-a791-cf05c85152fe req-3378a70f-714c-48b3-966f-c5643ad71ec0 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state building and task_state spawning.
Aug 17 08:34:38 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261278.967757, d6089253-9a85-4d00-82f9-950660857b54 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:34:38 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] VM Resumed (Lifecycle Event)
Aug 17 08:34:38 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:34:38 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:34:38 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] Instance spawned successfully.
Aug 17 08:34:38 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:34:39 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261278.9892166, d6089253-9a85-4d00-82f9-950660857b54 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:34:39 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] VM Started (Lifecycle Event)
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:34:39 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:34:39 user nova-compute[72998]: INFO nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 17 08:34:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:34:39 user nova-compute[72998]: INFO nova.compute.manager [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Took 38.63 seconds to build instance.
Aug 17 08:34:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d8ab1025-21bc-4586-8da4-6cf560eddd13 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d6089253-9a85-4d00-82f9-950660857b54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.726s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:34:45 user nova-compute[72998]: INFO nova.compute.claims [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Claim successful on node user
Aug 17 08:34:45 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:34:45 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:34:45 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:34:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG nova.policy [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd26b8d5e31fc4b2aaba3ea57936cc6cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854d040e58e2418398176f53fd728654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:34:46 user nova-compute[72998]: INFO nova.virt.block_device [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Booting with volume ef96c9bc-b3c3-4285-98f7-b70ad91aed0e at /dev/vda
Aug 17 08:34:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG os_brick.utils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d35f419-7305-4867-a548-3067f2594fcf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f462c29f-8c42-4a82-b4ef-50220ffce2fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[543c8d6a-6226-49b4-b104-b518f49cbb5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b617d2e-3844-4466-9a9b-07b47c79935c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:34:46 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:34:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3061fd4-0a01-4864-8142-df6ee7cfe275]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG os_brick.utils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:34:46 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Updating existing volume attachment record: b4b7fdb1-701a-4260-99e2-c889c970b1fb {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Successfully created port: f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquiring lock "13485771-8264-445b-9a87-d8ae6c5f5059" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "13485771-8264-445b-9a87-d8ae6c5f5059" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquiring lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:47 user nova-compute[72998]: INFO nova.compute.manager [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Terminating instance
Aug 17 08:34:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-de0e6217-10db-416c-8ab3-7eb7822492d4 req-089cca4b-1d59-40f3-9666-34572077b341 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received event network-vif-unplugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-de0e6217-10db-416c-8ab3-7eb7822492d4 req-089cca4b-1d59-40f3-9666-34572077b341 service nova] Acquiring lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-de0e6217-10db-416c-8ab3-7eb7822492d4 req-089cca4b-1d59-40f3-9666-34572077b341 service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-de0e6217-10db-416c-8ab3-7eb7822492d4 req-089cca4b-1d59-40f3-9666-34572077b341 service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-de0e6217-10db-416c-8ab3-7eb7822492d4 req-089cca4b-1d59-40f3-9666-34572077b341 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] No waiting events found dispatching network-vif-unplugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-de0e6217-10db-416c-8ab3-7eb7822492d4 req-089cca4b-1d59-40f3-9666-34572077b341 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received event network-vif-unplugged-deefbde5-35a7-493b-a5e4-01ecda913094 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Instance destroyed successfully.
Aug 17 08:34:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lazy-loading 'resources' on Instance uuid 13485771-8264-445b-9a87-d8ae6c5f5059 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-150586897',display_name='tempest-VolumesNegativeTest-instance-150586897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-150586897',id=32,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:33:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eedc56886624f8eb4d1a04425dd8241',ramdisk_id='',reservation_id='r-s74yv0vl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1181903025',owner_user_name='tempest-VolumesNegativeTest-1181903025-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:33:04Z,user_data=None,user_id='df283a3a7ba64882abbe14968974753e',uuid=13485771-8264-445b-9a87-d8ae6c5f5059,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Converting VIF {"id": "deefbde5-35a7-493b-a5e4-01ecda913094", "address": "fa:16:3e:9d:e7:94", "network": {"id": "1327b4d4-0ee7-4c02-a388-d34c4e1c01dd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bd1b2e952e7746f0b4f07fcf9c92ca08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeefbde5-35", "ovs_interfaceid": "deefbde5-35a7-493b-a5e4-01ecda913094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=deefbde5-35a7-493b-a5e4-01ecda913094,network=Network(1327b4d4-0ee7-4c02-a388-d34c4e1c01dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeefbde5-35') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG os_vif [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=deefbde5-35a7-493b-a5e4-01ecda913094,network=Network(1327b4d4-0ee7-4c02-a388-d34c4e1c01dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeefbde5-35') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeefbde5-35, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:48 user nova-compute[72998]: INFO os_vif [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=deefbde5-35a7-493b-a5e4-01ecda913094,network=Network(1327b4d4-0ee7-4c02-a388-d34c4e1c01dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeefbde5-35')
Aug 17 08:34:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Deleting instance files /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059_del
Aug 17 08:34:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Deletion of /opt/stack/data/nova/instances/13485771-8264-445b-9a87-d8ae6c5f5059_del complete
Aug 17 08:34:48 user nova-compute[72998]: INFO nova.compute.manager [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 17 08:34:48 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Successfully updated port: f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "refresh_cache-66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquired lock "refresh_cache-66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:48 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Took 0.76 seconds to deallocate network for instance.
Aug 17 08:34:48 user nova-compute[72998]: DEBUG nova.compute.manager [req-d890f3ea-5535-4a5c-9d12-2f75e6d29a06 req-67fc2389-3fe4-4eb7-84a0-cfac73092750 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received event network-vif-deleted-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Updating instance_info_cache with network_info: [{"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Releasing lock "refresh_cache-66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance network_info: |[{"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:49 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Deleted allocations for instance 13485771-8264-445b-9a87-d8ae6c5f5059
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8e7ca084-b3e8-4c6e-b1d6-721f6b26009b tempest-VolumesNegativeTest-1181903025 tempest-VolumesNegativeTest-1181903025-project-member] Lock "13485771-8264-445b-9a87-d8ae6c5f5059" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.040s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received event network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] Acquiring lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] No waiting events found dispatching network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:34:49 user nova-compute[72998]: WARNING nova.compute.manager [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received unexpected event network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 for instance with vm_state deleted and task_state None.
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received event network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] Acquiring lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] Lock "13485771-8264-445b-9a87-d8ae6c5f5059-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] No waiting events found dispatching network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:34:49 user nova-compute[72998]: WARNING nova.compute.manager [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Received unexpected event network-vif-plugged-deefbde5-35a7-493b-a5e4-01ecda913094 for instance with vm_state deleted and task_state None.
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-changed-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Refreshing instance network info cache due to event network-changed-f16d574a-29ef-48bf-ad01-e265b40230e9. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] Acquiring lock "refresh_cache-66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] Acquired lock "refresh_cache-66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:34:49 user nova-compute[72998]: DEBUG nova.network.neutron [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Refreshing network info cache for port f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:34:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Updated VIF entry in instance network info cache for port f16d574a-29ef-48bf-ad01-e265b40230e9. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:34:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Updating instance_info_cache with network_info: [{"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1617a088-1750-4762-a9e1-823f126c78aa req-4233015f-dbaf-4088-9a4d-6e16a6674262 service nova] Releasing lock "refresh_cache-66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:34:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:34:56 user nova-compute[72998]: INFO nova.compute.claims [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Claim successful on node user
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.network.neutron [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:34:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.policy [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dedd991048b34559acc5465faf521198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77012255394ad0bab402375507d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:34:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Creating image(s)
Aug 17 08:34:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "/opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "/opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "/opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.194s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.363s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk 1073741824" returned: 0 in 0.055s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.426s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG nova.network.neutron [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Successfully created port: ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.226s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Cannot resize image /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG nova.objects.instance [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'migration_context' on Instance uuid 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Ensure instance console log exists: /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:34:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:34:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Successfully updated port: ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:34:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "refresh_cache-302be383-8a80-4d0f-80c5-01100b093c52" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:34:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquired lock "refresh_cache-302be383-8a80-4d0f-80c5-01100b093c52" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:34:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:34:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-ea70a31e-3c2f-4907-bfe4-11387e951f66 req-a3aa55ee-2b6c-4f24-8e79-c747ecc5bed1 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received event network-changed-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:34:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-ea70a31e-3c2f-4907-bfe4-11387e951f66 req-a3aa55ee-2b6c-4f24-8e79-c747ecc5bed1 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Refreshing instance network info cache due to event network-changed-ba4319da-a79b-4e38-ad70-442607efd550. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:34:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ea70a31e-3c2f-4907-bfe4-11387e951f66 req-a3aa55ee-2b6c-4f24-8e79-c747ecc5bed1 service nova] Acquiring lock "refresh_cache-302be383-8a80-4d0f-80c5-01100b093c52" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:34:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Updating instance_info_cache with network_info: [{"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Releasing lock "refresh_cache-302be383-8a80-4d0f-80c5-01100b093c52" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Instance network_info: |[{"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ea70a31e-3c2f-4907-bfe4-11387e951f66 req-a3aa55ee-2b6c-4f24-8e79-c747ecc5bed1 service nova] Acquired lock "refresh_cache-302be383-8a80-4d0f-80c5-01100b093c52" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.network.neutron [req-ea70a31e-3c2f-4907-bfe4-11387e951f66 req-a3aa55ee-2b6c-4f24-8e79-c747ecc5bed1 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Refreshing network info cache for port ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Start _get_guest_xml network_info=[{"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:34:59 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:34:59 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2101504959',display_name='tempest-AttachVolumeTestJSON-server-2101504959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2101504959',id=36,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmd6tcqWMz19SmDCEqQ2r1IzfLNO3sqOMyrNIFvs5gMeoUcT22YvqhzL8foOVyWsTP+AAjqn1hfdrmp8Sxog+8efmWLu+VeRwhznuvDE0PpIcs7bW+88G5Quqiia6pc8g==',key_name='tempest-keypair-1922305755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-fmijz1rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=302be383-8a80-4d0f-80c5-01100b093c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f1:20,bridge_name='br-int',has_traffic_filtering=True,id=ba4319da-a79b-4e38-ad70-442607efd550,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4319da-a7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.objects.instance [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'pci_devices' on Instance uuid 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:34:59 user nova-compute[72998]:   <uuid>302be383-8a80-4d0f-80c5-01100b093c52</uuid>
Aug 17 08:34:59 user nova-compute[72998]:   <name>instance-00000024</name>
Aug 17 08:34:59 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:34:59 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:34:59 user nova-compute[72998]:   <metadata>
Aug 17 08:34:59 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:34:59 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:34:59 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeTestJSON-server-2101504959</nova:name>
Aug 17 08:34:59 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:34:59</nova:creationTime>
Aug 17 08:34:59 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:34:59 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:34:59 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:34:59 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:34:59 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:34:59 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:34:59 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:34:59 user nova-compute[72998]:       <nova:owner>
Aug 17 08:34:59 user nova-compute[72998]:         <nova:user uuid="dedd991048b34559acc5465faf521198">tempest-AttachVolumeTestJSON-1538733103-project-member</nova:user>
Aug 17 08:34:59 user nova-compute[72998]:         <nova:project uuid="be77012255394ad0bab402375507d6ef">tempest-AttachVolumeTestJSON-1538733103</nova:project>
Aug 17 08:34:59 user nova-compute[72998]:       </nova:owner>
Aug 17 08:34:59 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:34:59 user nova-compute[72998]:       <nova:ports>
Aug 17 08:34:59 user nova-compute[72998]:         <nova:port uuid="ba4319da-a79b-4e38-ad70-442607efd550">
Aug 17 08:34:59 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 08:34:59 user nova-compute[72998]:         </nova:port>
Aug 17 08:34:59 user nova-compute[72998]:       </nova:ports>
Aug 17 08:34:59 user nova-compute[72998]:     </nova:instance>
Aug 17 08:34:59 user nova-compute[72998]:   </metadata>
Aug 17 08:34:59 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:34:59 user nova-compute[72998]:     <system>
Aug 17 08:34:59 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:34:59 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:34:59 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:34:59 user nova-compute[72998]:       <entry name="serial">302be383-8a80-4d0f-80c5-01100b093c52</entry>
Aug 17 08:34:59 user nova-compute[72998]:       <entry name="uuid">302be383-8a80-4d0f-80c5-01100b093c52</entry>
Aug 17 08:34:59 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:34:59 user nova-compute[72998]:     </system>
Aug 17 08:34:59 user nova-compute[72998]:   </sysinfo>
Aug 17 08:34:59 user nova-compute[72998]:   <os>
Aug 17 08:34:59 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:34:59 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:34:59 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:34:59 user nova-compute[72998]:   </os>
Aug 17 08:34:59 user nova-compute[72998]:   <features>
Aug 17 08:34:59 user nova-compute[72998]:     <acpi/>
Aug 17 08:34:59 user nova-compute[72998]:     <apic/>
Aug 17 08:34:59 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:34:59 user nova-compute[72998]:   </features>
Aug 17 08:34:59 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:34:59 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:34:59 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:34:59 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:34:59 user nova-compute[72998]:   </clock>
Aug 17 08:34:59 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:34:59 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:34:59 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:34:59 user nova-compute[72998]:   </cpu>
Aug 17 08:34:59 user nova-compute[72998]:   <devices>
Aug 17 08:34:59 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:34:59 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:34:59 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk"/>
Aug 17 08:34:59 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:34:59 user nova-compute[72998]:     </disk>
Aug 17 08:34:59 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:34:59 user nova-compute[72998]:       <mac address="fa:16:3e:0f:f1:20"/>
Aug 17 08:34:59 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:34:59 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:34:59 user nova-compute[72998]:       <target dev="tapba4319da-a7"/>
Aug 17 08:34:59 user nova-compute[72998]:     </interface>
Aug 17 08:34:59 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:34:59 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/console.log" append="off"/>
Aug 17 08:34:59 user nova-compute[72998]:     </serial>
Aug 17 08:34:59 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:34:59 user nova-compute[72998]:     <video>
Aug 17 08:34:59 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:34:59 user nova-compute[72998]:     </video>
Aug 17 08:34:59 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:34:59 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:34:59 user nova-compute[72998]:     </rng>
Aug 17 08:34:59 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:34:59 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:34:59 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:34:59 user nova-compute[72998]:     </memballoon>
Aug 17 08:34:59 user nova-compute[72998]:   </devices>
Aug 17 08:34:59 user nova-compute[72998]: </domain>
Aug 17 08:34:59 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2101504959',display_name='tempest-AttachVolumeTestJSON-server-2101504959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2101504959',id=36,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmd6tcqWMz19SmDCEqQ2r1IzfLNO3sqOMyrNIFvs5gMeoUcT22YvqhzL8foOVyWsTP+AAjqn1hfdrmp8Sxog+8efmWLu+VeRwhznuvDE0PpIcs7bW+88G5Quqiia6pc8g==',key_name='tempest-keypair-1922305755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-fmijz1rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=302be383-8a80-4d0f-80c5-01100b093c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f1:20,bridge_name='br-int',has_traffic_filtering=True,id=ba4319da-a79b-4e38-ad70-442607efd550,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4319da-a7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG os_vif [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f1:20,bridge_name='br-int',has_traffic_filtering=True,id=ba4319da-a79b-4e38-ad70-442607efd550,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4319da-a7') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4319da-a7, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba4319da-a7, col_values=(('external_ids', {'iface-id': 'ba4319da-a79b-4e38-ad70-442607efd550', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:f1:20', 'vm-uuid': '302be383-8a80-4d0f-80c5-01100b093c52'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:34:59 user nova-compute[72998]: INFO os_vif [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f1:20,bridge_name='br-int',has_traffic_filtering=True,id=ba4319da-a79b-4e38-ad70-442607efd550,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4319da-a7')
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:34:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No VIF found with MAC fa:16:3e:0f:f1:20, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:35:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-ea70a31e-3c2f-4907-bfe4-11387e951f66 req-a3aa55ee-2b6c-4f24-8e79-c747ecc5bed1 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Updated VIF entry in instance network info cache for port ba4319da-a79b-4e38-ad70-442607efd550. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:35:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-ea70a31e-3c2f-4907-bfe4-11387e951f66 req-a3aa55ee-2b6c-4f24-8e79-c747ecc5bed1 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Updating instance_info_cache with network_info: [{"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:35:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ea70a31e-3c2f-4907-bfe4-11387e951f66 req-a3aa55ee-2b6c-4f24-8e79-c747ecc5bed1 service nova] Releasing lock "refresh_cache-302be383-8a80-4d0f-80c5-01100b093c52" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG nova.compute.manager [req-499fca5b-4f4e-4912-b957-c06b7334a379 req-adb5f380-00ed-4c63-b9dc-293e70670b5e service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received event network-vif-plugged-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-499fca5b-4f4e-4912-b957-c06b7334a379 req-adb5f380-00ed-4c63-b9dc-293e70670b5e service nova] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-499fca5b-4f4e-4912-b957-c06b7334a379 req-adb5f380-00ed-4c63-b9dc-293e70670b5e service nova] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-499fca5b-4f4e-4912-b957-c06b7334a379 req-adb5f380-00ed-4c63-b9dc-293e70670b5e service nova] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG nova.compute.manager [req-499fca5b-4f4e-4912-b957-c06b7334a379 req-adb5f380-00ed-4c63-b9dc-293e70670b5e service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] No waiting events found dispatching network-vif-plugged-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:35:01 user nova-compute[72998]: WARNING nova.compute.manager [req-499fca5b-4f4e-4912-b957-c06b7334a379 req-adb5f380-00ed-4c63-b9dc-293e70670b5e service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received unexpected event network-vif-plugged-ba4319da-a79b-4e38-ad70-442607efd550 for instance with vm_state building and task_state spawning.
Aug 17 08:35:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:02 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261287.9762208, 13485771-8264-445b-9a87-d8ae6c5f5059 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:35:02 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] VM Stopped (Lifecycle Event)
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-68725c84-339d-42b5-bf1d-00e4b9cc9ab1 None None] [instance: 13485771-8264-445b-9a87-d8ae6c5f5059] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-0c617de3-7244-4061-8a61-d262ff17d5f7 req-df85f7c4-a129-483f-8147-8cf1df63333f service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received event network-vif-plugged-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0c617de3-7244-4061-8a61-d262ff17d5f7 req-df85f7c4-a129-483f-8147-8cf1df63333f service nova] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0c617de3-7244-4061-8a61-d262ff17d5f7 req-df85f7c4-a129-483f-8147-8cf1df63333f service nova] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0c617de3-7244-4061-8a61-d262ff17d5f7 req-df85f7c4-a129-483f-8147-8cf1df63333f service nova] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.compute.manager [req-0c617de3-7244-4061-8a61-d262ff17d5f7 req-df85f7c4-a129-483f-8147-8cf1df63333f service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] No waiting events found dispatching network-vif-plugged-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:35:03 user nova-compute[72998]: WARNING nova.compute.manager [req-0c617de3-7244-4061-8a61-d262ff17d5f7 req-df85f7c4-a129-483f-8147-8cf1df63333f service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received unexpected event network-vif-plugged-ba4319da-a79b-4e38-ad70-442607efd550 for instance with vm_state building and task_state spawning.
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261303.484206, 302be383-8a80-4d0f-80c5-01100b093c52 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:35:03 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] VM Resumed (Lifecycle Event)
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:35:03 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Instance spawned successfully.
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:35:03 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261303.4893003, 302be383-8a80-4d0f-80c5-01100b093c52 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:35:03 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] VM Started (Lifecycle Event)
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:35:03 user nova-compute[72998]: INFO nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Took 6.74 seconds to spawn the instance on the hypervisor.
Aug 17 08:35:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:03 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:35:03 user nova-compute[72998]: INFO nova.compute.manager [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Took 7.44 seconds to build instance.
Aug 17 08:35:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-0393e236-fbae-4497-b61a-aefaeb4699f5 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.546s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:35:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:35:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:35:09 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:35:10 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updating instance_info_cache with network_info: [{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:35:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:35:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:14 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:14 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:35:14 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:14 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:35:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Creating image(s)
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Ensure instance console log exists: /opt/stack/data/nova/instances/66cb9c6d-7132-45ef-bb88-2c8b1f13fff1/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Start _get_guest_xml network_info=[{"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b4b7fdb1-701a-4260-99e2-c889c970b1fb', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBxdFnyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66cb9c6d-7132-45ef-bb88-2c8b1f13fff1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef96c9bc-b3c3-4285-98f7-b70ad91aed0e', 'serial': 'ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:35:15 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:35:15 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBxdFnyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:35:15 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:35:15 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:35:15 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e142bb-9749-46c2-bb68-45ae66cf52d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:35:15 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec19d8ac-6885-4b3b-b9f1-113ced6875d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e] added
Aug 17 08:35:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee67eb3e-944d-4b0a-99ab-0c30a59339b1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3303bd-0922-4e11-a3c1-50d079002f5d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBxdFnyj {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBxdFnyj" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82c9fe-6c6d-4f58-89df-d5f28810da88]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NBxdFnyj'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1cb126-1e0e-467d-979a-3c5156b255a8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7459d676-bdaf-41e7-aa4c-41e1b451093a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:35:15 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:35:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:35:15 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:35:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d65d45a-dcb1-4eb1-809f-288c42bbb8bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260]
Aug 17 08:35:15 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260] successful.
Aug 17 08:35:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d0d86-8b2d-43ae-8d59-f05789978f9f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afe8a61-5117-4665-9dcd-73c4d55589b4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:35:15 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:35:15 user nova-compute[72998]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:35:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:35:15 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:35:15 user nova-compute[72998]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:35:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e0e5a-70f9-4570-a83d-3c8935559e2e]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBxdFnyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:35:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '26330663565393362', 'path': '/dev/sdd'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330663565393362', 'path': '/dev/sdd'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-373519911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-373519911',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAXiPkoFsXDsszomH4a9tiB8HL1Q+bw4C9LQroNiBYVkTwJmVfrYdjrMYHaRjACSIyjiNtavkgq7vxeh9nR4rRVtOwBdAR2qonBhGQBGb0c3M8+WtbliPvywE6AH7wbTA==',key_name='tempest-keypair-1902106096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='854d040e58e2418398176f53fd728654',ramdisk_id='',reservation_id='r-u3a3dveb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1189732577',owner_user_name='tempest-ServerActionsV293TestJSON-1189732577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d26b8d5e31fc4b2aaba3ea57936cc6cb',uuid=66cb9c6d-7132-45ef-bb88-2c8b1f13fff1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converting VIF {"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lazy-loading 'pci_devices' on Instance uuid 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:35:16 user nova-compute[72998]:   <uuid>66cb9c6d-7132-45ef-bb88-2c8b1f13fff1</uuid>
Aug 17 08:35:16 user nova-compute[72998]:   <name>instance-00000023</name>
Aug 17 08:35:16 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:35:16 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:35:16 user nova-compute[72998]:   <metadata>
Aug 17 08:35:16 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:35:16 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:35:16 user nova-compute[72998]:       <nova:name>tempest-ServerActionsV293TestJSON-server-373519911</nova:name>
Aug 17 08:35:16 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:35:15</nova:creationTime>
Aug 17 08:35:16 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:35:16 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:35:16 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:35:16 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:35:16 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:35:16 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:35:16 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:35:16 user nova-compute[72998]:       <nova:owner>
Aug 17 08:35:16 user nova-compute[72998]:         <nova:user uuid="d26b8d5e31fc4b2aaba3ea57936cc6cb">tempest-ServerActionsV293TestJSON-1189732577-project-member</nova:user>
Aug 17 08:35:16 user nova-compute[72998]:         <nova:project uuid="854d040e58e2418398176f53fd728654">tempest-ServerActionsV293TestJSON-1189732577</nova:project>
Aug 17 08:35:16 user nova-compute[72998]:       </nova:owner>
Aug 17 08:35:16 user nova-compute[72998]:       <nova:ports>
Aug 17 08:35:16 user nova-compute[72998]:         <nova:port uuid="f16d574a-29ef-48bf-ad01-e265b40230e9">
Aug 17 08:35:16 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 08:35:16 user nova-compute[72998]:         </nova:port>
Aug 17 08:35:16 user nova-compute[72998]:       </nova:ports>
Aug 17 08:35:16 user nova-compute[72998]:     </nova:instance>
Aug 17 08:35:16 user nova-compute[72998]:   </metadata>
Aug 17 08:35:16 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:35:16 user nova-compute[72998]:     <system>
Aug 17 08:35:16 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:35:16 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:35:16 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:35:16 user nova-compute[72998]:       <entry name="serial">66cb9c6d-7132-45ef-bb88-2c8b1f13fff1</entry>
Aug 17 08:35:16 user nova-compute[72998]:       <entry name="uuid">66cb9c6d-7132-45ef-bb88-2c8b1f13fff1</entry>
Aug 17 08:35:16 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:35:16 user nova-compute[72998]:     </system>
Aug 17 08:35:16 user nova-compute[72998]:   </sysinfo>
Aug 17 08:35:16 user nova-compute[72998]:   <os>
Aug 17 08:35:16 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:35:16 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:35:16 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:35:16 user nova-compute[72998]:   </os>
Aug 17 08:35:16 user nova-compute[72998]:   <features>
Aug 17 08:35:16 user nova-compute[72998]:     <acpi/>
Aug 17 08:35:16 user nova-compute[72998]:     <apic/>
Aug 17 08:35:16 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:35:16 user nova-compute[72998]:   </features>
Aug 17 08:35:16 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:35:16 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:35:16 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:35:16 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:35:16 user nova-compute[72998]:   </clock>
Aug 17 08:35:16 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:35:16 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:35:16 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:35:16 user nova-compute[72998]:   </cpu>
Aug 17 08:35:16 user nova-compute[72998]:   <devices>
Aug 17 08:35:16 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:35:16 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:35:16 user nova-compute[72998]:       <source dev="/dev/sdd"/>
Aug 17 08:35:16 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:35:16 user nova-compute[72998]:       <serial>ef96c9bc-b3c3-4285-98f7-b70ad91aed0e</serial>
Aug 17 08:35:16 user nova-compute[72998]:     </disk>
Aug 17 08:35:16 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:35:16 user nova-compute[72998]:       <mac address="fa:16:3e:59:14:4d"/>
Aug 17 08:35:16 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:35:16 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:35:16 user nova-compute[72998]:       <target dev="tapf16d574a-29"/>
Aug 17 08:35:16 user nova-compute[72998]:     </interface>
Aug 17 08:35:16 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:35:16 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/66cb9c6d-7132-45ef-bb88-2c8b1f13fff1/console.log" append="off"/>
Aug 17 08:35:16 user nova-compute[72998]:     </serial>
Aug 17 08:35:16 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:35:16 user nova-compute[72998]:     <video>
Aug 17 08:35:16 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:35:16 user nova-compute[72998]:     </video>
Aug 17 08:35:16 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:35:16 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:35:16 user nova-compute[72998]:     </rng>
Aug 17 08:35:16 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:35:16 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:35:16 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:35:16 user nova-compute[72998]:     </memballoon>
Aug 17 08:35:16 user nova-compute[72998]:   </devices>
Aug 17 08:35:16 user nova-compute[72998]: </domain>
Aug 17 08:35:16 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-373519911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-373519911',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAXiPkoFsXDsszomH4a9tiB8HL1Q+bw4C9LQroNiBYVkTwJmVfrYdjrMYHaRjACSIyjiNtavkgq7vxeh9nR4rRVtOwBdAR2qonBhGQBGb0c3M8+WtbliPvywE6AH7wbTA==',key_name='tempest-keypair-1902106096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='854d040e58e2418398176f53fd728654',ramdisk_id='',reservation_id='r-u3a3dveb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1189732577',owner_user_name='tempest-ServerActionsV293TestJSON-1189732577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d26b8d5e31fc4b2aaba3ea57936cc6cb',uuid=66cb9c6d-7132-45ef-bb88-2c8b1f13fff1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converting VIF {"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG os_vif [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf16d574a-29, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf16d574a-29, col_values=(('external_ids', {'iface-id': 'f16d574a-29ef-48bf-ad01-e265b40230e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:14:4d', 'vm-uuid': '66cb9c6d-7132-45ef-bb88-2c8b1f13fff1'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:16 user nova-compute[72998]: INFO os_vif [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29')
Aug 17 08:35:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:35:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] No VIF found with MAC fa:16:3e:59:14:4d, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:35:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:35:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7893MB free_disk=24.062191009521484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d6089253-9a85-4d00-82f9-950660857b54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 8c162466-8bc9-467d-955b-0ab0c4aa5693 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 302be383-8a80-4d0f-80c5-01100b093c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.manager [req-8b754de8-5dd3-4a69-aa0c-50b875506bb4 req-e99ee951-5401-49ed-a31c-6eda32e5cd8c service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8b754de8-5dd3-4a69-aa0c-50b875506bb4 req-e99ee951-5401-49ed-a31c-6eda32e5cd8c service nova] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8b754de8-5dd3-4a69-aa0c-50b875506bb4 req-e99ee951-5401-49ed-a31c-6eda32e5cd8c service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8b754de8-5dd3-4a69-aa0c-50b875506bb4 req-e99ee951-5401-49ed-a31c-6eda32e5cd8c service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:18 user nova-compute[72998]: DEBUG nova.compute.manager [req-8b754de8-5dd3-4a69-aa0c-50b875506bb4 req-e99ee951-5401-49ed-a31c-6eda32e5cd8c service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] No waiting events found dispatching network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:35:18 user nova-compute[72998]: WARNING nova.compute.manager [req-8b754de8-5dd3-4a69-aa0c-50b875506bb4 req-e99ee951-5401-49ed-a31c-6eda32e5cd8c service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received unexpected event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 for instance with vm_state building and task_state spawning.
Aug 17 08:35:19 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:35:19 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:35:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:35:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.952s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:20 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261320.9795396, 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:35:20 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] VM Resumed (Lifecycle Event)
Aug 17 08:35:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:35:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:35:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-0dbd4631-1ec6-400a-9431-80c6d247f445 req-c76d346c-3584-4082-8587-c209a54b4ec0 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:35:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0dbd4631-1ec6-400a-9431-80c6d247f445 req-c76d346c-3584-4082-8587-c209a54b4ec0 service nova] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0dbd4631-1ec6-400a-9431-80c6d247f445 req-c76d346c-3584-4082-8587-c209a54b4ec0 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0dbd4631-1ec6-400a-9431-80c6d247f445 req-c76d346c-3584-4082-8587-c209a54b4ec0 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-0dbd4631-1ec6-400a-9431-80c6d247f445 req-c76d346c-3584-4082-8587-c209a54b4ec0 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] No waiting events found dispatching network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:35:20 user nova-compute[72998]: WARNING nova.compute.manager [req-0dbd4631-1ec6-400a-9431-80c6d247f445 req-c76d346c-3584-4082-8587-c209a54b4ec0 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received unexpected event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 for instance with vm_state building and task_state spawning.
Aug 17 08:35:20 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance spawned successfully.
Aug 17 08:35:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:35:21 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261320.9818046, 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:35:21 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] VM Started (Lifecycle Event)
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:35:21 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:35:21 user nova-compute[72998]: INFO nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 17 08:35:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:21 user nova-compute[72998]: INFO nova.compute.manager [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Took 35.70 seconds to build instance.
Aug 17 08:35:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f8685e3b-1d96-445a-bb5c-fc012d991b9a tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.822s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:23 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 08:35:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 08:35:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:35:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 08:35:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:51 user nova-compute[72998]: INFO nova.compute.manager [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Rescuing
Aug 17 08:35:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:35:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquired lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:35:51 user nova-compute[72998]: DEBUG nova.network.neutron [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:35:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG nova.network.neutron [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Updating instance_info_cache with network_info: [{"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Releasing lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-52751d87-0117-40ea-b8fe-201c9d4d727f req-f9611690-f18a-42b4-a05e-fd03dea161c1 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-unplugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-52751d87-0117-40ea-b8fe-201c9d4d727f req-f9611690-f18a-42b4-a05e-fd03dea161c1 service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-52751d87-0117-40ea-b8fe-201c9d4d727f req-f9611690-f18a-42b4-a05e-fd03dea161c1 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-52751d87-0117-40ea-b8fe-201c9d4d727f req-f9611690-f18a-42b4-a05e-fd03dea161c1 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-52751d87-0117-40ea-b8fe-201c9d4d727f req-f9611690-f18a-42b4-a05e-fd03dea161c1 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-unplugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:35:52 user nova-compute[72998]: WARNING nova.compute.manager [req-52751d87-0117-40ea-b8fe-201c9d4d727f req-f9611690-f18a-42b4-a05e-fd03dea161c1 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-unplugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state active and task_state rescuing.
Aug 17 08:35:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] Instance destroyed successfully.
Aug 17 08:35:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Attempting a stable device rescue
Aug 17 08:35:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72998) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 08:35:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Instance directory exists: not creating {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 08:35:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Creating image(s)
Aug 17 08:35:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "/opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "/opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'trusted_certs' on Instance uuid d6089253-9a85-4d00-82f9-950660857b54 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:35:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "ca123f115e0da2f088db7549e6ae3efa47427510" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ca123f115e0da2f088db7549e6ae3efa47427510" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510.part --force-share --output=json" returned: 0 in 0.193s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG nova.virt.images [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] 818cfea7-98e7-4a2c-a637-18ceca76d76d was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510.part /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-d678087a-fbd0-4830-8f35-c406307d1c1a req-304dd7b4-146b-4425-9d0a-b5f6db39412c service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d678087a-fbd0-4830-8f35-c406307d1c1a req-304dd7b4-146b-4425-9d0a-b5f6db39412c service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d678087a-fbd0-4830-8f35-c406307d1c1a req-304dd7b4-146b-4425-9d0a-b5f6db39412c service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d678087a-fbd0-4830-8f35-c406307d1c1a req-304dd7b4-146b-4425-9d0a-b5f6db39412c service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-d678087a-fbd0-4830-8f35-c406307d1c1a req-304dd7b4-146b-4425-9d0a-b5f6db39412c service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:35:54 user nova-compute[72998]: WARNING nova.compute.manager [req-d678087a-fbd0-4830-8f35-c406307d1c1a req-304dd7b4-146b-4425-9d0a-b5f6db39412c service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state active and task_state rescuing.
Aug 17 08:35:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510.part /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510.converted" returned: 0 in 0.464s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ca123f115e0da2f088db7549e6ae3efa47427510" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.014s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "ca123f115e0da2f088db7549e6ae3efa47427510" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ca123f115e0da2f088db7549e6ae3efa47427510" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510 --force-share --output=json" returned: 0 in 0.212s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510,backing_fmt=raw /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510,backing_fmt=raw /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue" returned: 0 in 0.053s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ca123f115e0da2f088db7549e6ae3efa47427510" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'migration_context' on Instance uuid d6089253-9a85-4d00-82f9-950660857b54 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Start _get_guest_xml network_info=[{"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "vif_mac": "fa:16:3e:33:0d:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '818cfea7-98e7-4a2c-a637-18ceca76d76d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0dcdfe5f-76bf-41c5-805b-e1f16941cd84', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amhEwoqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd6089253-9a85-4d00-82f9-950660857b54', 'attached_at': '', 'detached_at': '', 'volume_id': '7f919e88-0e8b-41ac-8b02-7fea832df6a3', 'serial': '7f919e88-0e8b-41ac-8b02-7fea832df6a3'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'resources' on Instance uuid d6089253-9a85-4d00-82f9-950660857b54 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'numa_topology' on Instance uuid d6089253-9a85-4d00-82f9-950660857b54 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:35:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:35:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6089253-9a85-4d00-82f9-950660857b54 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amhEwoqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:35:55 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:35:55 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:35:55 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd91977-f7de-412e-95e7-25e9aa56537d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = amhEwoqp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 08:35:55 user nova-compute[72998]: node.name = iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3
Aug 17 08:35:55 user nova-compute[72998]: node.tpgt = -1
Aug 17 08:35:55 user nova-compute[72998]: node.startup = automatic
Aug 17 08:35:55 user nova-compute[72998]: node.leading_login = No
Aug 17 08:35:55 user nova-compute[72998]: iface.iscsi_ifacename = default
Aug 17 08:35:55 user nova-compute[72998]: iface.net_ifacename = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.ipaddress = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.prefix_len = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.hwaddress = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.transport_name = tcp
Aug 17 08:35:55 user nova-compute[72998]: iface.initiatorname = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.state = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.vlan_id = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.vlan_priority = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.vlan_state = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.iface_num = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.mtu = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.port = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.bootproto = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.subnet_mask = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.gateway = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.dhcp_alt_client_id = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.dhcp_dns = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.dhcp_learn_iqn = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.dhcp_vendor_id_state = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.dhcp_vendor_id = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.dhcp_slp_da = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.fragmentation = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.gratuitous_arp = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.incoming_forwarding = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.tos_state = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.tos = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.ttl = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.delayed_ack = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.tcp_nagle = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.tcp_wsf_state = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.tcp_wsf = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.tcp_timer_scale = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.tcp_timestamp = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.redirect = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.def_task_mgmt_timeout = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.header_digest = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.data_digest = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.immediate_data = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.initial_r2t = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.data_seq_inorder = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.data_pdu_inorder = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.erl = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.max_receive_data_len = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.first_burst_len = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.max_outstanding_r2t = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.max_burst_len = 0
Aug 17 08:35:55 user nova-compute[72998]: iface.chap_auth = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.bidi_chap = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.strict_login_compliance = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.discovery_auth = <empty>
Aug 17 08:35:55 user nova-compute[72998]: iface.discovery_logout = <empty>
Aug 17 08:35:55 user nova-compute[72998]: node.discovery_address = <empty>
Aug 17 08:35:55 user nova-compute[72998]: node.discovery_port = 0
Aug 17 08:35:55 user nova-compute[72998]: node.discovery_type = static
Aug 17 08:35:55 user nova-compute[72998]: node.session.initial_cmdsn = 0
Aug 17 08:35:55 user nova-compute[72998]: node.session.initial_login_retry_max = 8
Aug 17 08:35:55 user nova-compute[72998]: node.session.xmit_thread_priority = -20
Aug 17 08:35:55 user nova-compute[72998]: node.session.cmds_max = 128
Aug 17 08:35:55 user nova-compute[72998]: node.session.queue_depth = 32
Aug 17 08:35:55 user nova-compute[72998]: node.session.nr_sessions = 1
Aug 17 08:35:55 user nova-compute[72998]: node.session.auth.authmethod = CHAP
Aug 17 08:35:55 user nova-compute[72998]: node.session.auth.username = amhEwoqp
Aug 17 08:35:55 user nova-compute[72998]: node.session.auth.password = ***
Aug 17 08:35:55 user nova-compute[72998]: node.session.auth.username_in = <empty>
Aug 17 08:35:55 user nova-compute[72998]: node.session.auth.password_in = <empty>
Aug 17 08:35:55 user nova-compute[72998]: node.session.auth.chap_algs = MD5
Aug 17 08:35:55 user nova-compute[72998]: node.session.timeo.replacement_timeout = 120
Aug 17 08:35:55 user nova-compute[72998]: node.session.err_timeo.abort_timeout = 15
Aug 17 08:35:55 user nova-compute[72998]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 08:35:55 user nova-compute[72998]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 08:35:55 user nova-compute[72998]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.FastAbort = Yes
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.InitialR2T = No
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.ImmediateData = Yes
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.MaxConnections = 1
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 08:35:55 user nova-compute[72998]: node.session.iscsi.ERL = 0
Aug 17 08:35:55 user nova-compute[72998]: node.session.scan = manual
Aug 17 08:35:55 user nova-compute[72998]: node.session.reopen_max = 0
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].address = 172.16.0.220
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].port = 3260
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].startup = manual
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].tcp.window_size = 524288
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].tcp.type_of_service = 0
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].timeo.logout_timeout = 15
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].timeo.login_timeout = 15
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].timeo.auth_timeout = 45
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].iscsi.DataDigest = None
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].iscsi.IFMarker = No
Aug 17 08:35:55 user nova-compute[72998]: node.conn[0].iscsi.OFMarker = No
Aug 17 08:35:55 user nova-compute[72998]: # END RECORD
Aug 17 08:35:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[297a73e4-1374-461f-a2b1-2ad60cea5422]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f5ab8e-4d42-46ce-8f3a-9ad59df54c0d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amhEwoqp {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amhEwoqp" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1601b131-74bd-4fbf-b427-123555fb3cc8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'amhEwoqp'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[097ff02a-927d-423b-a9f4-b0fc7592b545]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b22ddd-18bf-4b23-8cf9-007f2772344a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:35:55 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:35:55 user nova-compute[72998]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:35:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:35:55 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:35:55 user nova-compute[72998]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:35:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] HCTL ('33', '0', '0', 0) found on session 36 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc600a52-c9a0-4aac-b6be-019e23f24210]: (4, ('0 0 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Searching for a device in session 36 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amhEwoqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '26434383832663065', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434383832663065', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1027641458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1027641458',id=33,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:34:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-3nym79wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:34:39Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=d6089253-9a85-4d00-82f9-950660857b54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "vif_mac": "fa:16:3e:33:0d:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "vif_mac": "fa:16:3e:33:0d:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:0d:43,bridge_name='br-int',has_traffic_filtering=True,id=c5e8bfc2-5587-4650-a5d0-af67de1044bb,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e8bfc2-55') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'pci_devices' on Instance uuid d6089253-9a85-4d00-82f9-950660857b54 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:35:55 user nova-compute[72998]:   <uuid>d6089253-9a85-4d00-82f9-950660857b54</uuid>
Aug 17 08:35:55 user nova-compute[72998]:   <name>instance-00000021</name>
Aug 17 08:35:55 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:35:55 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:35:55 user nova-compute[72998]:   <metadata>
Aug 17 08:35:55 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:35:55 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:35:55 user nova-compute[72998]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1027641458</nova:name>
Aug 17 08:35:55 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:35:55</nova:creationTime>
Aug 17 08:35:55 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:35:55 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:35:55 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:35:55 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:35:55 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:35:55 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:35:55 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:35:55 user nova-compute[72998]:       <nova:owner>
Aug 17 08:35:55 user nova-compute[72998]:         <nova:user uuid="cf94d9d63f9e4e5a9d0a4f175fddff16">tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member</nova:user>
Aug 17 08:35:55 user nova-compute[72998]:         <nova:project uuid="0ef0a0f5a7b6484483231263041317df">tempest-ServerBootFromVolumeStableRescueTest-1298365870</nova:project>
Aug 17 08:35:55 user nova-compute[72998]:       </nova:owner>
Aug 17 08:35:55 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:35:55 user nova-compute[72998]:       <nova:ports>
Aug 17 08:35:55 user nova-compute[72998]:         <nova:port uuid="c5e8bfc2-5587-4650-a5d0-af67de1044bb">
Aug 17 08:35:55 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 08:35:55 user nova-compute[72998]:         </nova:port>
Aug 17 08:35:55 user nova-compute[72998]:       </nova:ports>
Aug 17 08:35:55 user nova-compute[72998]:     </nova:instance>
Aug 17 08:35:55 user nova-compute[72998]:   </metadata>
Aug 17 08:35:55 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:35:55 user nova-compute[72998]:     <system>
Aug 17 08:35:55 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:35:55 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:35:55 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:35:55 user nova-compute[72998]:       <entry name="serial">d6089253-9a85-4d00-82f9-950660857b54</entry>
Aug 17 08:35:55 user nova-compute[72998]:       <entry name="uuid">d6089253-9a85-4d00-82f9-950660857b54</entry>
Aug 17 08:35:55 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:35:55 user nova-compute[72998]:     </system>
Aug 17 08:35:55 user nova-compute[72998]:   </sysinfo>
Aug 17 08:35:55 user nova-compute[72998]:   <os>
Aug 17 08:35:55 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:35:55 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:35:55 user nova-compute[72998]:   </os>
Aug 17 08:35:55 user nova-compute[72998]:   <features>
Aug 17 08:35:55 user nova-compute[72998]:     <acpi/>
Aug 17 08:35:55 user nova-compute[72998]:     <apic/>
Aug 17 08:35:55 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:35:55 user nova-compute[72998]:   </features>
Aug 17 08:35:55 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:35:55 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:35:55 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:35:55 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:35:55 user nova-compute[72998]:   </clock>
Aug 17 08:35:55 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:35:55 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:35:55 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:35:55 user nova-compute[72998]:   </cpu>
Aug 17 08:35:55 user nova-compute[72998]:   <devices>
Aug 17 08:35:55 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:35:55 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:35:55 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 08:35:55 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:35:55 user nova-compute[72998]:       <serial>7f919e88-0e8b-41ac-8b02-7fea832df6a3</serial>
Aug 17 08:35:55 user nova-compute[72998]:     </disk>
Aug 17 08:35:55 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:35:55 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:35:55 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue"/>
Aug 17 08:35:55 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:35:55 user nova-compute[72998]:       <boot order="1"/>
Aug 17 08:35:55 user nova-compute[72998]:     </disk>
Aug 17 08:35:55 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:35:55 user nova-compute[72998]:       <mac address="fa:16:3e:33:0d:43"/>
Aug 17 08:35:55 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:35:55 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:35:55 user nova-compute[72998]:       <target dev="tapc5e8bfc2-55"/>
Aug 17 08:35:55 user nova-compute[72998]:     </interface>
Aug 17 08:35:55 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:35:55 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/console.log" append="off"/>
Aug 17 08:35:55 user nova-compute[72998]:     </serial>
Aug 17 08:35:55 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:35:55 user nova-compute[72998]:     <video>
Aug 17 08:35:55 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:35:55 user nova-compute[72998]:     </video>
Aug 17 08:35:55 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:35:55 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:35:55 user nova-compute[72998]:     </rng>
Aug 17 08:35:55 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:35:55 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:35:55 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:35:55 user nova-compute[72998]:     </memballoon>
Aug 17 08:35:55 user nova-compute[72998]:   </devices>
Aug 17 08:35:55 user nova-compute[72998]: </domain>
Aug 17 08:35:55 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:35:55 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] Instance destroyed successfully.
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:35:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] No VIF found with MAC fa:16:3e:33:0d:43, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:35:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-467562d7-0b51-4910-a0ee-46da391f80bf req-c12e8d95-6d92-475c-b747-8f4154881c0e service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-467562d7-0b51-4910-a0ee-46da391f80bf req-c12e8d95-6d92-475c-b747-8f4154881c0e service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-467562d7-0b51-4910-a0ee-46da391f80bf req-c12e8d95-6d92-475c-b747-8f4154881c0e service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-467562d7-0b51-4910-a0ee-46da391f80bf req-c12e8d95-6d92-475c-b747-8f4154881c0e service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-467562d7-0b51-4910-a0ee-46da391f80bf req-c12e8d95-6d92-475c-b747-8f4154881c0e service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:35:57 user nova-compute[72998]: WARNING nova.compute.manager [req-467562d7-0b51-4910-a0ee-46da391f80bf req-c12e8d95-6d92-475c-b747-8f4154881c0e service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state active and task_state rescuing.
Aug 17 08:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-a75f6e47-5b90-4243-9d00-d459e36c831b req-a1076ef1-4356-465d-b752-d035e8d00acd service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:35:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a75f6e47-5b90-4243-9d00-d459e36c831b req-a1076ef1-4356-465d-b752-d035e8d00acd service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:35:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a75f6e47-5b90-4243-9d00-d459e36c831b req-a1076ef1-4356-465d-b752-d035e8d00acd service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:35:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a75f6e47-5b90-4243-9d00-d459e36c831b req-a1076ef1-4356-465d-b752-d035e8d00acd service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-a75f6e47-5b90-4243-9d00-d459e36c831b req-a1076ef1-4356-465d-b752-d035e8d00acd service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:35:59 user nova-compute[72998]: WARNING nova.compute.manager [req-a75f6e47-5b90-4243-9d00-d459e36c831b req-a1076ef1-4356-465d-b752-d035e8d00acd service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state active and task_state rescuing.
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for d6089253-9a85-4d00-82f9-950660857b54 due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261359.4473603, d6089253-9a85-4d00-82f9-950660857b54 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:35:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] VM Resumed (Lifecycle Event)
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-c3c218b3-0d5d-442f-9285-8fbbf2cb4a9f tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:35:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261359.449915, d6089253-9a85-4d00-82f9-950660857b54 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:35:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] VM Started (Lifecycle Event)
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:35:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:36:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:36:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:36:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:36:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:36:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:36:12 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Updating instance_info_cache with network_info: [{"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:36:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:36:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:36:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "8c162466-8bc9-467d-955b-0ab0c4aa5693" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:14 user nova-compute[72998]: INFO nova.compute.manager [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Terminating instance
Aug 17 08:36:14 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:36:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-9ecb7f22-9ddb-47e5-b018-ce98f01cb3f2 req-f0de4343-9503-43ab-b5e3-53f8590d67c1 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received event network-vif-unplugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9ecb7f22-9ddb-47e5-b018-ce98f01cb3f2 req-f0de4343-9503-43ab-b5e3-53f8590d67c1 service nova] Acquiring lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9ecb7f22-9ddb-47e5-b018-ce98f01cb3f2 req-f0de4343-9503-43ab-b5e3-53f8590d67c1 service nova] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9ecb7f22-9ddb-47e5-b018-ce98f01cb3f2 req-f0de4343-9503-43ab-b5e3-53f8590d67c1 service nova] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-9ecb7f22-9ddb-47e5-b018-ce98f01cb3f2 req-f0de4343-9503-43ab-b5e3-53f8590d67c1 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] No waiting events found dispatching network-vif-unplugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-9ecb7f22-9ddb-47e5-b018-ce98f01cb3f2 req-f0de4343-9503-43ab-b5e3-53f8590d67c1 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received event network-vif-unplugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:36:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Instance destroyed successfully.
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lazy-loading 'resources' on Instance uuid 8c162466-8bc9-467d-955b-0ab0c4aa5693 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1490360562',display_name='tempest-ServersNegativeTestJSON-server-1490360562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1490360562',id=34,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:34:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80cd55d2a46440109d871d95b275ee35',ramdisk_id='',reservation_id='r-q8xamabf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-767382591',owner_user_name='tempest-ServersNegativeTestJSON-767382591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:34:33Z,user_data=None,user_id='f38547b6181642c8b51ff26c5cece96a',uuid=8c162466-8bc9-467d-955b-0ab0c4aa5693,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converting VIF {"id": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "address": "fa:16:3e:7a:df:84", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a8fe95-da", "ovs_interfaceid": "42a8fe95-dab5-4fe8-a3c0-948e77ad9d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:df:84,bridge_name='br-int',has_traffic_filtering=True,id=42a8fe95-dab5-4fe8-a3c0-948e77ad9d86,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a8fe95-da') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG os_vif [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:df:84,bridge_name='br-int',has_traffic_filtering=True,id=42a8fe95-dab5-4fe8-a3c0-948e77ad9d86,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a8fe95-da') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42a8fe95-da, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:15 user nova-compute[72998]: INFO os_vif [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:df:84,bridge_name='br-int',has_traffic_filtering=True,id=42a8fe95-dab5-4fe8-a3c0-948e77ad9d86,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a8fe95-da')
Aug 17 08:36:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Deleting instance files /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693_del
Aug 17 08:36:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Deletion of /opt/stack/data/nova/instances/8c162466-8bc9-467d-955b-0ab0c4aa5693_del complete
Aug 17 08:36:15 user nova-compute[72998]: INFO nova.compute.manager [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:36:15 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Took 0.44 seconds to deallocate network for instance.
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:16 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Deleted allocations for instance 8c162466-8bc9-467d-955b-0ab0c4aa5693
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a71d7ace-af78-4d35-89f1-7d8597770920 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-8f0b0250-9744-4d3e-b1a1-9132c08578f0 req-cf5520e7-a0b8-402d-8776-3083b575fa28 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received event network-vif-plugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8f0b0250-9744-4d3e-b1a1-9132c08578f0 req-cf5520e7-a0b8-402d-8776-3083b575fa28 service nova] Acquiring lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8f0b0250-9744-4d3e-b1a1-9132c08578f0 req-cf5520e7-a0b8-402d-8776-3083b575fa28 service nova] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8f0b0250-9744-4d3e-b1a1-9132c08578f0 req-cf5520e7-a0b8-402d-8776-3083b575fa28 service nova] Lock "8c162466-8bc9-467d-955b-0ab0c4aa5693-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-8f0b0250-9744-4d3e-b1a1-9132c08578f0 req-cf5520e7-a0b8-402d-8776-3083b575fa28 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] No waiting events found dispatching network-vif-plugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:36:17 user nova-compute[72998]: WARNING nova.compute.manager [req-8f0b0250-9744-4d3e-b1a1-9132c08578f0 req-cf5520e7-a0b8-402d-8776-3083b575fa28 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received unexpected event network-vif-plugged-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 for instance with vm_state deleted and task_state None.
Aug 17 08:36:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-8f0b0250-9744-4d3e-b1a1-9132c08578f0 req-cf5520e7-a0b8-402d-8776-3083b575fa28 service nova] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Received event network-vif-deleted-42a8fe95-dab5-4fe8-a3c0-948e77ad9d86 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:36:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=23.95479965209961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d6089253-9a85-4d00-82f9-950660857b54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 302be383-8a80-4d0f-80c5-01100b093c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:36:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:36:19 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:36:19 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:36:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:36:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:20 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:20 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:20 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:36:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:20 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:23 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:25 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:36:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:30 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261375.3123326, 8c162466-8bc9-467d-955b-0ab0c4aa5693 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:36:30 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] VM Stopped (Lifecycle Event)
Aug 17 08:36:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-bff71022-2e53-4fc8-ad0b-339d468d766d None None] [instance: 8c162466-8bc9-467d-955b-0ab0c4aa5693] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:36:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-8d03995c-33e5-4267-a8e7-8c32f4a3b0f2 req-15de7ba4-4384-4f81-b62c-5bcd24344062 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-changed-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:36:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-8d03995c-33e5-4267-a8e7-8c32f4a3b0f2 req-15de7ba4-4384-4f81-b62c-5bcd24344062 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Refreshing instance network info cache due to event network-changed-f16d574a-29ef-48bf-ad01-e265b40230e9. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:36:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d03995c-33e5-4267-a8e7-8c32f4a3b0f2 req-15de7ba4-4384-4f81-b62c-5bcd24344062 service nova] Acquiring lock "refresh_cache-66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:36:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d03995c-33e5-4267-a8e7-8c32f4a3b0f2 req-15de7ba4-4384-4f81-b62c-5bcd24344062 service nova] Acquired lock "refresh_cache-66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:36:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-8d03995c-33e5-4267-a8e7-8c32f4a3b0f2 req-15de7ba4-4384-4f81-b62c-5bcd24344062 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Refreshing network info cache for port f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:36:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-8d03995c-33e5-4267-a8e7-8c32f4a3b0f2 req-15de7ba4-4384-4f81-b62c-5bcd24344062 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Updated VIF entry in instance network info cache for port f16d574a-29ef-48bf-ad01-e265b40230e9. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:36:37 user nova-compute[72998]: DEBUG nova.network.neutron [req-8d03995c-33e5-4267-a8e7-8c32f4a3b0f2 req-15de7ba4-4384-4f81-b62c-5bcd24344062 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Updating instance_info_cache with network_info: [{"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:36:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d03995c-33e5-4267-a8e7-8c32f4a3b0f2 req-15de7ba4-4384-4f81-b62c-5bcd24344062 service nova] Releasing lock "refresh_cache-66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:36:39 user nova-compute[72998]: INFO nova.compute.manager [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Rebuilding instance
Aug 17 08:36:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lazy-loading 'trusted_certs' on Instance uuid 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lazy-loading 'pci_requests' on Instance uuid 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lazy-loading 'pci_devices' on Instance uuid 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lazy-loading 'resources' on Instance uuid 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lazy-loading 'migration_context' on Instance uuid 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72998) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-cc7a7437-40e7-4d77-82fd-09dbca428290 req-ae295573-09be-48f7-a291-066aca09c2a6 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-unplugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cc7a7437-40e7-4d77-82fd-09dbca428290 req-ae295573-09be-48f7-a291-066aca09c2a6 service nova] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cc7a7437-40e7-4d77-82fd-09dbca428290 req-ae295573-09be-48f7-a291-066aca09c2a6 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cc7a7437-40e7-4d77-82fd-09dbca428290 req-ae295573-09be-48f7-a291-066aca09c2a6 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-cc7a7437-40e7-4d77-82fd-09dbca428290 req-ae295573-09be-48f7-a291-066aca09c2a6 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] No waiting events found dispatching network-vif-unplugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:36:39 user nova-compute[72998]: WARNING nova.compute.manager [req-cc7a7437-40e7-4d77-82fd-09dbca428290 req-ae295573-09be-48f7-a291-066aca09c2a6 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received unexpected event network-vif-unplugged-f16d574a-29ef-48bf-ad01-e265b40230e9 for instance with vm_state active and task_state rebuilding.
Aug 17 08:36:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance destroyed successfully.
Aug 17 08:36:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance destroyed successfully.
Aug 17 08:36:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1204377761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-373519911',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAXiPkoFsXDsszomH4a9tiB8HL1Q+bw4C9LQroNiBYVkTwJmVfrYdjrMYHaRjACSIyjiNtavkgq7vxeh9nR4rRVtOwBdAR2qonBhGQBGb0c3M8+WtbliPvywE6AH7wbTA==',key_name='tempest-keypair-1902106096',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:35:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='854d040e58e2418398176f53fd728654',ramdisk_id='',reservation_id='r-u3a3dveb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1189732577',owner_user_name='tempest-ServerActionsV293TestJSON-1189732577-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d26b8d5e31fc4b2aaba3ea57936cc6cb',uuid=66cb9c6d-7132-45ef-bb88-2c8b1f13fff1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converting VIF {"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_vif [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf16d574a-29, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:40 user nova-compute[72998]: INFO os_vif [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29')
Aug 17 08:36:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBxdFnyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:36:40 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c88a6d-a443-4c8a-b823-5983a64ca16b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[096f4d6f-d4f5-4d88-be80-66fad33633f0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:36:40 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:36:40 user nova-compute[72998]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:36:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:36:40 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:36:40 user nova-compute[72998]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:36:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4884d5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'): ({'sdd'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Removing single pathed devices sdd {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf52f14-d4c9-46bd-9505-0f2821404d67]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c614f17-f5eb-46c7-a458-1d85dcd4a39b]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Flushing IO for device /dev/sdd {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc73d28d-a3a2-4b21-8024-f6fdf0c4f1a3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b9c22-2979-495a-8177-e28e52c94d02]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c752acbe', '/dev/disk/by-id/scsi-1SCST_BIOc752acbe-c0f5e93b34103cfa', '/dev/disk/by-id/scsi-26330663565393362') {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8d7553-3ed3-41b0-bcbd-c6e792702755]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8a10f7-26a0-4d07-8ca1-ff3b09e8fea9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a65de14-a914-4f82-b258-90b4ce2127ac]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260]
Aug 17 08:36:40 user nova-compute[72998]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260] successful.
Aug 17 08:36:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3296fd13-abcd-4054-9827-a6cc7d8c07a0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] <== disconnect_volume: return (339ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:36:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:36:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Deleting instance files /opt/stack/data/nova/instances/66cb9c6d-7132-45ef-bb88-2c8b1f13fff1_del
Aug 17 08:36:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Deletion of /opt/stack/data/nova/instances/66cb9c6d-7132-45ef-bb88-2c8b1f13fff1_del complete
Aug 17 08:36:41 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 could not be found.
Aug 17 08:36:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBxdFnyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:36:41 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d47f347-1511-4764-8fd6-e8feedc19ee0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd0dd38-e44a-4cc1-a46a-7ff4dd9003f9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:36:41 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:36:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:36:41 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:36:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488567b50>, {}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Disconnecting from: [] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] <== disconnect_volume: return (53ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Preparing to wait for external event volume-reimaged-ef96c9bc-b3c3-4285-98f7-b70ad91aed0e {{(pid=72998) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-27155b97-c448-4aa1-b598-13d317f1f7f7 req-5e8c288a-0842-43f3-88ca-cb76724c819d service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-27155b97-c448-4aa1-b598-13d317f1f7f7 req-5e8c288a-0842-43f3-88ca-cb76724c819d service nova] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-27155b97-c448-4aa1-b598-13d317f1f7f7 req-5e8c288a-0842-43f3-88ca-cb76724c819d service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-27155b97-c448-4aa1-b598-13d317f1f7f7 req-5e8c288a-0842-43f3-88ca-cb76724c819d service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-27155b97-c448-4aa1-b598-13d317f1f7f7 req-5e8c288a-0842-43f3-88ca-cb76724c819d service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] No event matching network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 in dict_keys([('volume-reimaged', 'ef96c9bc-b3c3-4285-98f7-b70ad91aed0e')]) {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 17 08:36:41 user nova-compute[72998]: WARNING nova.compute.manager [req-27155b97-c448-4aa1-b598-13d317f1f7f7 req-5e8c288a-0842-43f3-88ca-cb76724c819d service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received unexpected event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 for instance with vm_state active and task_state rebuilding.
Aug 17 08:36:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-ff92699b-b834-4741-8978-9c3d8ef04776 req-0fa234f4-2e90-4466-a3c7-ae1b848d2178 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received event network-changed-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:36:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-ff92699b-b834-4741-8978-9c3d8ef04776 req-0fa234f4-2e90-4466-a3c7-ae1b848d2178 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Refreshing instance network info cache due to event network-changed-ba4319da-a79b-4e38-ad70-442607efd550. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:36:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ff92699b-b834-4741-8978-9c3d8ef04776 req-0fa234f4-2e90-4466-a3c7-ae1b848d2178 service nova] Acquiring lock "refresh_cache-302be383-8a80-4d0f-80c5-01100b093c52" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:36:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ff92699b-b834-4741-8978-9c3d8ef04776 req-0fa234f4-2e90-4466-a3c7-ae1b848d2178 service nova] Acquired lock "refresh_cache-302be383-8a80-4d0f-80c5-01100b093c52" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:36:47 user nova-compute[72998]: DEBUG nova.network.neutron [req-ff92699b-b834-4741-8978-9c3d8ef04776 req-0fa234f4-2e90-4466-a3c7-ae1b848d2178 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Refreshing network info cache for port ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:36:47 user nova-compute[72998]: DEBUG nova.network.neutron [req-ff92699b-b834-4741-8978-9c3d8ef04776 req-0fa234f4-2e90-4466-a3c7-ae1b848d2178 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Updated VIF entry in instance network info cache for port ba4319da-a79b-4e38-ad70-442607efd550. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:36:47 user nova-compute[72998]: DEBUG nova.network.neutron [req-ff92699b-b834-4741-8978-9c3d8ef04776 req-0fa234f4-2e90-4466-a3c7-ae1b848d2178 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Updating instance_info_cache with network_info: [{"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:36:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ff92699b-b834-4741-8978-9c3d8ef04776 req-0fa234f4-2e90-4466-a3c7-ae1b848d2178 service nova] Releasing lock "refresh_cache-302be383-8a80-4d0f-80c5-01100b093c52" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:36:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:36:52 user nova-compute[72998]: INFO nova.compute.manager [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Attaching volume e40c073c-ec04-449e-a355-4431dad7af4e to /dev/vdb
Aug 17 08:36:52 user nova-compute[72998]: DEBUG os_brick.utils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[29450ff7-17ee-422d-bdb4-3effb8145faf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab0eadb-adb7-4ceb-bd29-b27b24c0e1ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfad60e-d860-45a6-8d41-236e2ab8b687]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[273abb3b-ff5e-49df-867f-8cdf6487f960]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:36:52 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:36:52 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a657cf5-33b3-4ba6-8698-bbd7a1989de4]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG os_brick.utils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:36:52 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Updating existing volume attachment record: 20246518-f32e-4e26-9f16-3510cd0cfa54 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:36:55 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261400.4444008, 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:36:55 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] VM Stopped (Lifecycle Event)
Aug 17 08:36:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-94424441-6671-475e-b120-572228c2b982 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:36:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:36:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCfQiDhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:37:04 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:37:04 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:37:04 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b0324c-94fd-44dc-945d-5d4321fdc05d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:37:04 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c29d818-8406-491c-aa9e-ae9faf2b31e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e] added
Aug 17 08:37:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae6376c-f223-4805-a93b-18edab32b93f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca043d-1a44-4b52-95fa-3fb98e96502f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCfQiDhn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCfQiDhn" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49c690e-126c-4627-a885-e6e2dffc9eae]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCfQiDhn'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa6a497-14b6-4d90-a0e5-855e8eb09d1b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee7ee4d-987f-4998-ac31-6edb3dd5f4f5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:04 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:04 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf43f6-1956-4ad1-9972-a47e8d5bdffb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e, portal: 172.16.0.220,3260]
Aug 17 08:37:04 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e, portal: 172.16.0.220,3260] successful.
Aug 17 08:37:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d7b011-55a2-4207-8ead-dd67c74f06de]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ddd47d-d462-4e6c-b55d-f6f273cd082d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:04 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:04 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:04 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:04 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925e4f4-4d7e-4747-8b8b-3d84da432261]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:37:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCfQiDhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG nova.compute.manager [req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 req-0b2c4707-be9b-4be5-a9b2-4d71a557364d service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event volume-reimaged-ef96c9bc-b3c3-4285-98f7-b70ad91aed0e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 req-0b2c4707-be9b-4be5-a9b2-4d71a557364d service nova] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 req-0b2c4707-be9b-4be5-a9b2-4d71a557364d service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 req-0b2c4707-be9b-4be5-a9b2-4d71a557364d service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG nova.compute.manager [req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 req-0b2c4707-be9b-4be5-a9b2-4d71a557364d service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Processing event volume-reimaged-ef96c9bc-b3c3-4285-98f7-b70ad91aed0e {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:37:05 user nova-compute[72998]: INFO nova.virt.block_device [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Booting with volume ef96c9bc-b3c3-4285-98f7-b70ad91aed0e at /dev/vda
Aug 17 08:37:05 user nova-compute[72998]: DEBUG os_brick.utils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e5fce1-6577-4b7d-957a-235d082b6e14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eadd74-4609-4157-a2ee-c13c627aaeac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e6141e-544c-42ea-b098-266c67fe4048]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30b1c21-ae16-43e1-b9e1-1f6584ecf898]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:37:05 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:37:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57aebfa-57ee-4656-9f12-1378650e416f]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG os_brick.utils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Updating existing volume attachment record: 34f21311-3512-4681-ad38-6b83570639d9 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23632333234663461', 'path': '/dev/sdd'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632333234663461', 'path': '/dev/sdd'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:37:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:37:05 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:37:05 user nova-compute[72998]:   <source dev="/dev/sdd"/>
Aug 17 08:37:05 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:37:05 user nova-compute[72998]:   <serial>e40c073c-ec04-449e-a355-4431dad7af4e</serial>
Aug 17 08:37:05 user nova-compute[72998]: </disk>
Aug 17 08:37:05 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:37:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:37:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:37:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No VIF found with MAC fa:16:3e:0f:f1:20, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:37:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a02ba28c-0972-4acd-9505-c852e69d607d tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.075s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:37:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:37:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:37:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:37:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:12 user nova-compute[72998]: INFO nova.compute.manager [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Attaching volume 670cb759-2c09-4edc-8039-3df89a861a30 to /dev/vdc
Aug 17 08:37:12 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Updating instance_info_cache with network_info: [{"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG os_brick.utils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd27fd91-38ee-42b3-a758-102d23fb95a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae837f9-eb17-4471-9faa-1e956e445f7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[117315ed-485d-46ea-87eb-91e711e7f85d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e48730-e91e-4038-8392-f5d2764365d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:37:12 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:37:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de040c4-a1b9-4bf9-9504-9fc8becbaba9]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG os_brick.utils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:37:12 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Updating existing volume attachment record: a197d4ab-2018-4430-9ded-cc5af860c4d5 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:37:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:37:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:37:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:37:17 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Creating image(s)
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Ensure instance console log exists: /opt/stack/data/nova/instances/66cb9c6d-7132-45ef-bb88-2c8b1f13fff1/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Start _get_guest_xml network_info=[{"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '34f21311-3512-4681-ad38-6b83570639d9', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBxdFnyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66cb9c6d-7132-45ef-bb88-2c8b1f13fff1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef96c9bc-b3c3-4285-98f7-b70ad91aed0e', 'serial': 'ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:37:17 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 08:37:17 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBxdFnyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:37:17 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:37:17 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:37:17 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a43234-1fa6-4b51-a150-cdccecadb57e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:37:17 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba76302-232d-451d-b0dc-87f47cfd7433]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e] added
Aug 17 08:37:17 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf7bc7-b59f-4faa-b23f-efbc514f4101]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[697af027-356d-4b36-bfc9-02258a2cf481]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBxdFnyj {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBxdFnyj" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f6d5d-bfbc-49cd-b4e3-f51b4ef36a0f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NBxdFnyj'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[278904cb-9f6c-4125-86f3-abcdef033799]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e541c7f6-40b4-4d32-9dda-dbf036415c30]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:17 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:17 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:17 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:17 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:17 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:17 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:37:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81d9e73-d61b-4fec-ae28-45ab85e838ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260]
Aug 17 08:37:18 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260] successful.
Aug 17 08:37:18 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3d5423-49ed-435c-ae1c-4d987f627f4a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b76034a-1732-4652-9ef7-3d392d89c43e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:18 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:18 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:18 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:18 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:18 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:18 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:18 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:18 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e938547e-a794-4818-8f2e-98668b2a5981]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBxdFnyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:37:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '26330663565393362', 'path': '/dev/sde'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330663565393362', 'path': '/dev/sde'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1204377761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-373519911',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAXiPkoFsXDsszomH4a9tiB8HL1Q+bw4C9LQroNiBYVkTwJmVfrYdjrMYHaRjACSIyjiNtavkgq7vxeh9nR4rRVtOwBdAR2qonBhGQBGb0c3M8+WtbliPvywE6AH7wbTA==',key_name='tempest-keypair-1902106096',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:35:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='854d040e58e2418398176f53fd728654',ramdisk_id='',reservation_id='r-u3a3dveb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1189732577',owner_user_name='tempest-ServerActionsV293TestJSON-1189732577-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:37:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d26b8d5e31fc4b2aaba3ea57936cc6cb',uuid=66cb9c6d-7132-45ef-bb88-2c8b1f13fff1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converting VIF {"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:37:19 user nova-compute[72998]:   <uuid>66cb9c6d-7132-45ef-bb88-2c8b1f13fff1</uuid>
Aug 17 08:37:19 user nova-compute[72998]:   <name>instance-00000023</name>
Aug 17 08:37:19 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:37:19 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:37:19 user nova-compute[72998]:   <metadata>
Aug 17 08:37:19 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:37:19 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:37:19 user nova-compute[72998]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1204377761</nova:name>
Aug 17 08:37:19 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:37:17</nova:creationTime>
Aug 17 08:37:19 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:37:19 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:37:19 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:37:19 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:37:19 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:37:19 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:37:19 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:37:19 user nova-compute[72998]:       <nova:owner>
Aug 17 08:37:19 user nova-compute[72998]:         <nova:user uuid="d26b8d5e31fc4b2aaba3ea57936cc6cb">tempest-ServerActionsV293TestJSON-1189732577-project-member</nova:user>
Aug 17 08:37:19 user nova-compute[72998]:         <nova:project uuid="854d040e58e2418398176f53fd728654">tempest-ServerActionsV293TestJSON-1189732577</nova:project>
Aug 17 08:37:19 user nova-compute[72998]:       </nova:owner>
Aug 17 08:37:19 user nova-compute[72998]:       <nova:ports>
Aug 17 08:37:19 user nova-compute[72998]:         <nova:port uuid="f16d574a-29ef-48bf-ad01-e265b40230e9">
Aug 17 08:37:19 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 08:37:19 user nova-compute[72998]:         </nova:port>
Aug 17 08:37:19 user nova-compute[72998]:       </nova:ports>
Aug 17 08:37:19 user nova-compute[72998]:     </nova:instance>
Aug 17 08:37:19 user nova-compute[72998]:   </metadata>
Aug 17 08:37:19 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:37:19 user nova-compute[72998]:     <system>
Aug 17 08:37:19 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:37:19 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:37:19 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:37:19 user nova-compute[72998]:       <entry name="serial">66cb9c6d-7132-45ef-bb88-2c8b1f13fff1</entry>
Aug 17 08:37:19 user nova-compute[72998]:       <entry name="uuid">66cb9c6d-7132-45ef-bb88-2c8b1f13fff1</entry>
Aug 17 08:37:19 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:37:19 user nova-compute[72998]:     </system>
Aug 17 08:37:19 user nova-compute[72998]:   </sysinfo>
Aug 17 08:37:19 user nova-compute[72998]:   <os>
Aug 17 08:37:19 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:37:19 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:37:19 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:37:19 user nova-compute[72998]:   </os>
Aug 17 08:37:19 user nova-compute[72998]:   <features>
Aug 17 08:37:19 user nova-compute[72998]:     <acpi/>
Aug 17 08:37:19 user nova-compute[72998]:     <apic/>
Aug 17 08:37:19 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:37:19 user nova-compute[72998]:   </features>
Aug 17 08:37:19 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:37:19 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:37:19 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:37:19 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:37:19 user nova-compute[72998]:   </clock>
Aug 17 08:37:19 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:37:19 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:37:19 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:37:19 user nova-compute[72998]:   </cpu>
Aug 17 08:37:19 user nova-compute[72998]:   <devices>
Aug 17 08:37:19 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:37:19 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:37:19 user nova-compute[72998]:       <source dev="/dev/sde"/>
Aug 17 08:37:19 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:37:19 user nova-compute[72998]:       <serial>ef96c9bc-b3c3-4285-98f7-b70ad91aed0e</serial>
Aug 17 08:37:19 user nova-compute[72998]:     </disk>
Aug 17 08:37:19 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:37:19 user nova-compute[72998]:       <mac address="fa:16:3e:59:14:4d"/>
Aug 17 08:37:19 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:37:19 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:37:19 user nova-compute[72998]:       <target dev="tapf16d574a-29"/>
Aug 17 08:37:19 user nova-compute[72998]:     </interface>
Aug 17 08:37:19 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:37:19 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/66cb9c6d-7132-45ef-bb88-2c8b1f13fff1/console.log" append="off"/>
Aug 17 08:37:19 user nova-compute[72998]:     </serial>
Aug 17 08:37:19 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:37:19 user nova-compute[72998]:     <video>
Aug 17 08:37:19 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:37:19 user nova-compute[72998]:     </video>
Aug 17 08:37:19 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:37:19 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:37:19 user nova-compute[72998]:     </rng>
Aug 17 08:37:19 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:37:19 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:37:19 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:37:19 user nova-compute[72998]:     </memballoon>
Aug 17 08:37:19 user nova-compute[72998]:   </devices>
Aug 17 08:37:19 user nova-compute[72998]: </domain>
Aug 17 08:37:19 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1204377761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-373519911',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAXiPkoFsXDsszomH4a9tiB8HL1Q+bw4C9LQroNiBYVkTwJmVfrYdjrMYHaRjACSIyjiNtavkgq7vxeh9nR4rRVtOwBdAR2qonBhGQBGb0c3M8+WtbliPvywE6AH7wbTA==',key_name='tempest-keypair-1902106096',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:35:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='854d040e58e2418398176f53fd728654',ramdisk_id='',reservation_id='r-u3a3dveb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1189732577',owner_user_name='tempest-ServerActionsV293TestJSON-1189732577-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:37:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d26b8d5e31fc4b2aaba3ea57936cc6cb',uuid=66cb9c6d-7132-45ef-bb88-2c8b1f13fff1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converting VIF {"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG os_vif [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf16d574a-29, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf16d574a-29, col_values=(('external_ids', {'iface-id': 'f16d574a-29ef-48bf-ad01-e265b40230e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:14:4d', 'vm-uuid': '66cb9c6d-7132-45ef-bb88-2c8b1f13fff1'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:19 user nova-compute[72998]: INFO os_vif [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29')
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] No VIF found with MAC fa:16:3e:59:14:4d, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:19 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:37:19 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:37:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8219MB free_disk=23.94998550415039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d6089253-9a85-4d00-82f9-950660857b54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 302be383-8a80-4d0f-80c5-01100b093c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-43f2fc58-a31c-4e28-a203-3d0d012e84f0 req-83a5603b-4166-43b7-a50f-91725deb04a7 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-43f2fc58-a31c-4e28-a203-3d0d012e84f0 req-83a5603b-4166-43b7-a50f-91725deb04a7 service nova] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-43f2fc58-a31c-4e28-a203-3d0d012e84f0 req-83a5603b-4166-43b7-a50f-91725deb04a7 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-43f2fc58-a31c-4e28-a203-3d0d012e84f0 req-83a5603b-4166-43b7-a50f-91725deb04a7 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:20 user nova-compute[72998]: DEBUG nova.compute.manager [req-43f2fc58-a31c-4e28-a203-3d0d012e84f0 req-83a5603b-4166-43b7-a50f-91725deb04a7 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] No waiting events found dispatching network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:37:20 user nova-compute[72998]: WARNING nova.compute.manager [req-43f2fc58-a31c-4e28-a203-3d0d012e84f0 req-83a5603b-4166-43b7-a50f-91725deb04a7 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received unexpected event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 08:37:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:37:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:37:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:37:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:37:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:37:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261442.7955022, 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:37:22 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] VM Resumed (Lifecycle Event)
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:37:22 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance spawned successfully.
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:37:22 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261442.7968915, 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:37:22 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] VM Started (Lifecycle Event)
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:37:22 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:22 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72998) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 08:37:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-b08ef5ca-1526-4e0b-a132-3ef29fb8ab7c req-e1385da5-7290-416a-aee8-df2a95e56d45 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b08ef5ca-1526-4e0b-a132-3ef29fb8ab7c req-e1385da5-7290-416a-aee8-df2a95e56d45 service nova] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b08ef5ca-1526-4e0b-a132-3ef29fb8ab7c req-e1385da5-7290-416a-aee8-df2a95e56d45 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b08ef5ca-1526-4e0b-a132-3ef29fb8ab7c req-e1385da5-7290-416a-aee8-df2a95e56d45 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-b08ef5ca-1526-4e0b-a132-3ef29fb8ab7c req-e1385da5-7290-416a-aee8-df2a95e56d45 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] No waiting events found dispatching network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:37:23 user nova-compute[72998]: WARNING nova.compute.manager [req-b08ef5ca-1526-4e0b-a132-3ef29fb8ab7c req-e1385da5-7290-416a-aee8-df2a95e56d45 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received unexpected event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 for instance with vm_state active and task_state None.
Aug 17 08:37:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2d0e9164-42e6-40ce-a5cb-b9adc14046e7 tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.070s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:23 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:37:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ckLTxHzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:37:39 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:37:39 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:37:39 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc9a715-671a-47b3-ab10-c113fdcecf36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:37:39 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b288e0-ad45-44e8-8a76-7a2b131e2875]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30] added
Aug 17 08:37:39 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7683ae3e-ea93-4378-ae0a-3032252153a3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[655a6299-e4d9-4bcd-a0d8-a806ece8b5d7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ckLTxHzG {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ckLTxHzG" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e00512-b558-45cc-8d21-f47415d2f1f1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ckLTxHzG'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7a89af-feb9-4648-99b3-8f0ab8fb724c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cd0700-4630-4622-95aa-69bf2271b06b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:39 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:39 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f814fb-80ed-4d93-9946-906b262e93a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30, portal: 172.16.0.220,3260]
Aug 17 08:37:39 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30, portal: 172.16.0.220,3260] successful.
Aug 17 08:37:39 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a92653-6804-4b01-8ed4-9add087c70a8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c2c3b0-ebd9-4c89-b25c-a2e939e1d7b1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:39 user nova-compute[72998]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 (non-flash)
Aug 17 08:37:39 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0aae296-ea65-479f-939e-23edb76e2497]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:37:39 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ckLTxHzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:37:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:37:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23533393261663461', 'path': '/dev/sdf'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:37:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533393261663461', 'path': '/dev/sdf'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:37:40 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:37:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:37:40 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:37:40 user nova-compute[72998]:   <source dev="/dev/sdf"/>
Aug 17 08:37:40 user nova-compute[72998]:   <target dev="vdc" bus="virtio"/>
Aug 17 08:37:40 user nova-compute[72998]:   <serial>670cb759-2c09-4edc-8039-3df89a861a30</serial>
Aug 17 08:37:40 user nova-compute[72998]: </disk>
Aug 17 08:37:40 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:37:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:37:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:37:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:37:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] No VIF found with MAC fa:16:3e:0f:f1:20, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:37:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8eb9fced-7c2a-4849-995b-8f44b96f40ed tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.946s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:42 user nova-compute[72998]: INFO nova.compute.manager [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Detaching volume e40c073c-ec04-449e-a355-4431dad7af4e
Aug 17 08:37:42 user nova-compute[72998]: INFO nova.virt.block_device [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Attempting to driver detach volume e40c073c-ec04-449e-a355-4431dad7af4e from mountpoint /dev/vdb
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Attempting to detach device vdb from instance 302be383-8a80-4d0f-80c5-01100b093c52 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:37:42 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:37:42 user nova-compute[72998]:   <source dev="/dev/sdd"/>
Aug 17 08:37:42 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:37:42 user nova-compute[72998]:   <serial>e40c073c-ec04-449e-a355-4431dad7af4e</serial>
Aug 17 08:37:42 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:37:42 user nova-compute[72998]: </disk>
Aug 17 08:37:42 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:37:42 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully detached device vdb from instance 302be383-8a80-4d0f-80c5-01100b093c52 from the persistent domain config.
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 302be383-8a80-4d0f-80c5-01100b093c52 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:37:42 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:37:42 user nova-compute[72998]:   <source dev="/dev/sdd"/>
Aug 17 08:37:42 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:37:42 user nova-compute[72998]:   <serial>e40c073c-ec04-449e-a355-4431dad7af4e</serial>
Aug 17 08:37:42 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:37:42 user nova-compute[72998]: </disk>
Aug 17 08:37:42 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:37:42 user nova-compute[72998]: INFO nova.compute.manager [None req-a6623e09-0a35-4085-8ee0-2efd7a13b1f2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Unrescuing
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a6623e09-0a35-4085-8ee0-2efd7a13b1f2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a6623e09-0a35-4085-8ee0-2efd7a13b1f2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquired lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a6623e09-0a35-4085-8ee0-2efd7a13b1f2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692261462.6335685, 302be383-8a80-4d0f-80c5-01100b093c52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:37:42 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully detached device vdb from instance 302be383-8a80-4d0f-80c5-01100b093c52 from the live domain config.
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCfQiDhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:37:42 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7348f87a-afa5-4ffc-8517-3fcf958f2a52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bccd1cd-578d-418c-9246-5e75b7d2a547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd43c41a-ab7a-4112-a193-e6dc70c0f60c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bccd1cd-578d-418c-9246-5e75b7d2a547 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bccd1cd-578d-418c-9246-5e75b7d2a547 (non-flash)
Aug 17 08:37:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 (non-flash)
Aug 17 08:37:42 user nova-compute[72998]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bccd1cd-578d-418c-9246-5e75b7d2a547 (non-flash)
Aug 17 08:37:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464e17ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e'): ({'sdd'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Removing single pathed devices sdd {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a04bf60-9489-4ebb-8477-650796be01b9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[995db649-6b64-4cf9-9f47-79ad19abdf59]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flushing IO for device /dev/sdd {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b45968-81db-48d7-98f2-cd609a49105b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4ee38f-4ad3-4dd3-83bf-0e93a9bacd2f]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] SCSI volumes sdd have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5512e4e1-f992-477d-a98f-89911b88dd53]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a6623e09-0a35-4085-8ee0-2efd7a13b1f2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Updating instance_info_cache with network_info: [{"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a6623e09-0a35-4085-8ee0-2efd7a13b1f2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Releasing lock "refresh_cache-d6089253-9a85-4d00-82f9-950660857b54" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a6623e09-0a35-4085-8ee0-2efd7a13b1f2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'flavor' on Instance uuid d6089253-9a85-4d00-82f9-950660857b54 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[986664d4-ddcd-4db4-ab3b-7f8b2feaa191]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e, portal: 172.16.0.220,3260]
Aug 17 08:37:42 user nova-compute[72998]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e, portal: 172.16.0.220,3260] successful.
Aug 17 08:37:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40c073c-ec04-449e-a355-4431dad7af4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[088aba13-a450-4549-bb0e-68e445bdec45]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== disconnect_volume: return (369ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-8deffe55-862e-48b5-84bc-4feae6ea6ca8 req-553adc2e-3d10-4859-a1c7-c400dab68841 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-unplugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8deffe55-862e-48b5-84bc-4feae6ea6ca8 req-553adc2e-3d10-4859-a1c7-c400dab68841 service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8deffe55-862e-48b5-84bc-4feae6ea6ca8 req-553adc2e-3d10-4859-a1c7-c400dab68841 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8deffe55-862e-48b5-84bc-4feae6ea6ca8 req-553adc2e-3d10-4859-a1c7-c400dab68841 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-8deffe55-862e-48b5-84bc-4feae6ea6ca8 req-553adc2e-3d10-4859-a1c7-c400dab68841 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-unplugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:37:43 user nova-compute[72998]: WARNING nova.compute.manager [req-8deffe55-862e-48b5-84bc-4feae6ea6ca8 req-553adc2e-3d10-4859-a1c7-c400dab68841 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-unplugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:37:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:44 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] Instance destroyed successfully.
Aug 17 08:37:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-ea0e3604-87b1-4637-b28a-2bb553207fbc req-a6959a5a-a58f-4172-b027-1536bbfec34e service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ea0e3604-87b1-4637-b28a-2bb553207fbc req-a6959a5a-a58f-4172-b027-1536bbfec34e service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ea0e3604-87b1-4637-b28a-2bb553207fbc req-a6959a5a-a58f-4172-b027-1536bbfec34e service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ea0e3604-87b1-4637-b28a-2bb553207fbc req-a6959a5a-a58f-4172-b027-1536bbfec34e service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-ea0e3604-87b1-4637-b28a-2bb553207fbc req-a6959a5a-a58f-4172-b027-1536bbfec34e service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:37:45 user nova-compute[72998]: WARNING nova.compute.manager [req-ea0e3604-87b1-4637-b28a-2bb553207fbc req-a6959a5a-a58f-4172-b027-1536bbfec34e service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:37:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-441d9fcb-5540-4acc-8925-8e79fd840240 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.965s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:37:47 user nova-compute[72998]: WARNING nova.compute.manager [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:37:47 user nova-compute[72998]: WARNING nova.compute.manager [req-99da11a5-9bb2-47c9-89e0-315195e7c5f0 req-fd3126d8-0a54-450d-b370-b418afdd8cd2 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state rescued and task_state unrescuing.
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a6623e09-0a35-4085-8ee0-2efd7a13b1f2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for d6089253-9a85-4d00-82f9-950660857b54 due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261467.910727, d6089253-9a85-4d00-82f9-950660857b54 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:37:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] VM Resumed (Lifecycle Event)
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:37:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261467.9109395, d6089253-9a85-4d00-82f9-950660857b54 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:37:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] VM Started (Lifecycle Event)
Aug 17 08:37:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:48 user nova-compute[72998]: INFO nova.compute.manager [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Detaching volume 670cb759-2c09-4edc-8039-3df89a861a30
Aug 17 08:37:48 user nova-compute[72998]: INFO nova.virt.block_device [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Attempting to driver detach volume 670cb759-2c09-4edc-8039-3df89a861a30 from mountpoint /dev/vdc
Aug 17 08:37:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Attempting to detach device vdc from instance 302be383-8a80-4d0f-80c5-01100b093c52 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:37:48 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:37:48 user nova-compute[72998]:   <source dev="/dev/sdf"/>
Aug 17 08:37:48 user nova-compute[72998]:   <target dev="vdc" bus="virtio"/>
Aug 17 08:37:48 user nova-compute[72998]:   <serial>670cb759-2c09-4edc-8039-3df89a861a30</serial>
Aug 17 08:37:48 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 08:37:48 user nova-compute[72998]: </disk>
Aug 17 08:37:48 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:37:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully detached device vdc from instance 302be383-8a80-4d0f-80c5-01100b093c52 from the persistent domain config.
Aug 17 08:37:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 302be383-8a80-4d0f-80c5-01100b093c52 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:37:48 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:37:48 user nova-compute[72998]:   <source dev="/dev/sdf"/>
Aug 17 08:37:48 user nova-compute[72998]:   <target dev="vdc" bus="virtio"/>
Aug 17 08:37:48 user nova-compute[72998]:   <serial>670cb759-2c09-4edc-8039-3df89a861a30</serial>
Aug 17 08:37:48 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 08:37:48 user nova-compute[72998]: </disk>
Aug 17 08:37:48 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692261468.9695206, 302be383-8a80-4d0f-80c5-01100b093c52 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:37:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully detached device vdc from instance 302be383-8a80-4d0f-80c5-01100b093c52 from the live domain config.
Aug 17 08:37:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ckLTxHzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:37:48 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:37:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:37:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4111c9-46bd-4014-8d30-19b97714b727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[16272108-6008-4d24-9569-ebd1a27a6909]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:49 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:49 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:49 user nova-compute[72998]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 (non-flash)
Aug 17 08:37:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:37:49 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:37:49 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:37:49 user nova-compute[72998]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 (non-flash)
Aug 17 08:37:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4b572b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30'): ({'sdf'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Removing single pathed devices sdf {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2786a3-e89f-47f7-bb64-73001361915b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a03857-5747-4eb0-bec0-6be9b79b30ba]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Flushing IO for device /dev/sdf {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[812be795-ae94-493c-afbb-dbdb242aa845]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.059s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc2d304-8de6-4bb6-8708-e113c5517552]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] SCSI volumes sdf have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1719177-c749-4f18-9301-9016fce6bded]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[265a62b8-93bd-4599-ba05-44aa7185945f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30, portal: 172.16.0.220,3260]
Aug 17 08:37:49 user nova-compute[72998]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30, portal: 172.16.0.220,3260] successful.
Aug 17 08:37:49 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670cb759-2c09-4edc-8039-3df89a861a30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e612ae4-7652-4b96-a72b-0ccd10ba8917]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] <== disconnect_volume: return (410ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:37:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:37:50 user nova-compute[72998]: DEBUG nova.objects.instance [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'flavor' on Instance uuid 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:37:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-aeb0b638-bb20-4514-b12e-9f1c12a8c438 tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.031s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:51 user nova-compute[72998]: INFO nova.compute.manager [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Terminating instance
Aug 17 08:37:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-29fa64fb-52fe-451c-a9d5-983bc9ecb60d req-d8d1cd35-7b18-4766-a500-38cb280e319e service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received event network-vif-unplugged-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-29fa64fb-52fe-451c-a9d5-983bc9ecb60d req-d8d1cd35-7b18-4766-a500-38cb280e319e service nova] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-29fa64fb-52fe-451c-a9d5-983bc9ecb60d req-d8d1cd35-7b18-4766-a500-38cb280e319e service nova] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-29fa64fb-52fe-451c-a9d5-983bc9ecb60d req-d8d1cd35-7b18-4766-a500-38cb280e319e service nova] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-29fa64fb-52fe-451c-a9d5-983bc9ecb60d req-d8d1cd35-7b18-4766-a500-38cb280e319e service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] No waiting events found dispatching network-vif-unplugged-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:37:51 user nova-compute[72998]: DEBUG nova.compute.manager [req-29fa64fb-52fe-451c-a9d5-983bc9ecb60d req-d8d1cd35-7b18-4766-a500-38cb280e319e service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received event network-vif-unplugged-ba4319da-a79b-4e38-ad70-442607efd550 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:37:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Instance destroyed successfully.
Aug 17 08:37:52 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lazy-loading 'resources' on Instance uuid 302be383-8a80-4d0f-80c5-01100b093c52 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2101504959',display_name='tempest-AttachVolumeTestJSON-server-2101504959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2101504959',id=36,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmd6tcqWMz19SmDCEqQ2r1IzfLNO3sqOMyrNIFvs5gMeoUcT22YvqhzL8foOVyWsTP+AAjqn1hfdrmp8Sxog+8efmWLu+VeRwhznuvDE0PpIcs7bW+88G5Quqiia6pc8g==',key_name='tempest-keypair-1922305755',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be77012255394ad0bab402375507d6ef',ramdisk_id='',reservation_id='r-fmijz1rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1538733103',owner_user_name='tempest-AttachVolumeTestJSON-1538733103-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dedd991048b34559acc5465faf521198',uuid=302be383-8a80-4d0f-80c5-01100b093c52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converting VIF {"id": "ba4319da-a79b-4e38-ad70-442607efd550", "address": "fa:16:3e:0f:f1:20", "network": {"id": "b9214964-d406-4be6-bec2-7c2073cb88cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-148949388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be77012255394ad0bab402375507d6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4319da-a7", "ovs_interfaceid": "ba4319da-a79b-4e38-ad70-442607efd550", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f1:20,bridge_name='br-int',has_traffic_filtering=True,id=ba4319da-a79b-4e38-ad70-442607efd550,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4319da-a7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG os_vif [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f1:20,bridge_name='br-int',has_traffic_filtering=True,id=ba4319da-a79b-4e38-ad70-442607efd550,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4319da-a7') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4319da-a7, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:37:52 user nova-compute[72998]: INFO os_vif [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f1:20,bridge_name='br-int',has_traffic_filtering=True,id=ba4319da-a79b-4e38-ad70-442607efd550,network=Network(b9214964-d406-4be6-bec2-7c2073cb88cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4319da-a7')
Aug 17 08:37:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Deleting instance files /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52_del
Aug 17 08:37:52 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Deletion of /opt/stack/data/nova/instances/302be383-8a80-4d0f-80c5-01100b093c52_del complete
Aug 17 08:37:52 user nova-compute[72998]: INFO nova.compute.manager [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 17 08:37:52 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:37:52 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:37:53 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:37:53 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Took 1.23 seconds to deallocate network for instance.
Aug 17 08:37:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-1a3a3dc8-1543-4d4c-abfd-635d7b0ff8e6 req-2e539aaf-71e4-4fb1-8774-e3e2ab2b4e04 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received event network-vif-plugged-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1a3a3dc8-1543-4d4c-abfd-635d7b0ff8e6 req-2e539aaf-71e4-4fb1-8774-e3e2ab2b4e04 service nova] Acquiring lock "302be383-8a80-4d0f-80c5-01100b093c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1a3a3dc8-1543-4d4c-abfd-635d7b0ff8e6 req-2e539aaf-71e4-4fb1-8774-e3e2ab2b4e04 service nova] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1a3a3dc8-1543-4d4c-abfd-635d7b0ff8e6 req-2e539aaf-71e4-4fb1-8774-e3e2ab2b4e04 service nova] Lock "302be383-8a80-4d0f-80c5-01100b093c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-1a3a3dc8-1543-4d4c-abfd-635d7b0ff8e6 req-2e539aaf-71e4-4fb1-8774-e3e2ab2b4e04 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] No waiting events found dispatching network-vif-plugged-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:37:53 user nova-compute[72998]: WARNING nova.compute.manager [req-1a3a3dc8-1543-4d4c-abfd-635d7b0ff8e6 req-2e539aaf-71e4-4fb1-8774-e3e2ab2b4e04 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received unexpected event network-vif-plugged-ba4319da-a79b-4e38-ad70-442607efd550 for instance with vm_state active and task_state deleting.
Aug 17 08:37:53 user nova-compute[72998]: DEBUG nova.compute.manager [req-1a3a3dc8-1543-4d4c-abfd-635d7b0ff8e6 req-2e539aaf-71e4-4fb1-8774-e3e2ab2b4e04 service nova] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Received event network-vif-deleted-ba4319da-a79b-4e38-ad70-442607efd550 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:37:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:37:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:37:53 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:37:54 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:37:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:54 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Deleted allocations for instance 302be383-8a80-4d0f-80c5-01100b093c52
Aug 17 08:37:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1289abb8-0cac-4552-9bb3-0a28d382284b tempest-AttachVolumeTestJSON-1538733103 tempest-AttachVolumeTestJSON-1538733103-project-member] Lock "302be383-8a80-4d0f-80c5-01100b093c52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.062s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:37:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:38:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:07 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261472.0896306, 302be383-8a80-4d0f-80c5-01100b093c52 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:38:07 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] VM Stopped (Lifecycle Event)
Aug 17 08:38:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ff3db9a4-3d94-484b-8681-b42b57e6b5de None None] [instance: 302be383-8a80-4d0f-80c5-01100b093c52] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:38:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:38:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:38:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:38:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:38:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8118MB free_disk=23.96640396118164GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d6089253-9a85-4d00-82f9-950660857b54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:38:18 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:38:19 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:38:19 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:38:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:38:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:19 user nova-compute[72998]: DEBUG nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:38:20 user nova-compute[72998]: INFO nova.compute.claims [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Claim successful on node user
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.network.neutron [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:38:20 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.policy [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2bda65353ee4488b74eda92e0d383e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb3156666b476f860039288c6b69c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:38:20 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Creating image(s)
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "/opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "/opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "/opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.187s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk 1073741824" returned: 0 in 0.057s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Successfully created port: 03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Cannot resize image /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lazy-loading 'migration_context' on Instance uuid cab97f26-4bc8-4d68-88b9-c3fc6932d88a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Ensure instance console log exists: /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG nova.network.neutron [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Successfully updated port: 03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "refresh_cache-cab97f26-4bc8-4d68-88b9-c3fc6932d88a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquired lock "refresh_cache-cab97f26-4bc8-4d68-88b9-c3fc6932d88a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG nova.network.neutron [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-7b724930-8fd0-4054-8e36-2129de19e7ee req-63a922ae-ac2a-49db-9825-27e8e43d344a service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received event network-changed-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-7b724930-8fd0-4054-8e36-2129de19e7ee req-63a922ae-ac2a-49db-9825-27e8e43d344a service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Refreshing instance network info cache due to event network-changed-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7b724930-8fd0-4054-8e36-2129de19e7ee req-63a922ae-ac2a-49db-9825-27e8e43d344a service nova] Acquiring lock "refresh_cache-cab97f26-4bc8-4d68-88b9-c3fc6932d88a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG nova.network.neutron [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG nova.network.neutron [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Updating instance_info_cache with network_info: [{"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Releasing lock "refresh_cache-cab97f26-4bc8-4d68-88b9-c3fc6932d88a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Instance network_info: |[{"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7b724930-8fd0-4054-8e36-2129de19e7ee req-63a922ae-ac2a-49db-9825-27e8e43d344a service nova] Acquired lock "refresh_cache-cab97f26-4bc8-4d68-88b9-c3fc6932d88a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG nova.network.neutron [req-7b724930-8fd0-4054-8e36-2129de19e7ee req-63a922ae-ac2a-49db-9825-27e8e43d344a service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Refreshing network info cache for port 03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:38:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Start _get_guest_xml network_info=[{"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:38:22 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:38:23 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1309825375',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1309825375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1309825',id=37,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExFIemO1KKIe47qEPIBGGzWQbGniVasX2PbD8+McGV3iK1/QVVJwKLO9PBhsU3OtYr/jw8Wow8puUsYBlXbPKowbhzRVz/y4tScgiYOowUWDwJkrd6upEsSVSElsQAnoQ==',key_name='tempest-keypair-683687485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffbb3156666b476f860039288c6b69c0',ramdisk_id='',reservation_id='r-fte5qlz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1045382181',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2bda65353ee4488b74eda92e0d383e7',uuid=cab97f26-4bc8-4d68-88b9-c3fc6932d88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Converting VIF {"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f4:c7,bridge_name='br-int',has_traffic_filtering=True,id=03247e13-2cbf-4cb9-a54f-8f06c4a9abf3,network=Network(c1d53fc8-c48b-4bf7-81de-1645f1f18d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247e13-2c') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.objects.instance [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lazy-loading 'pci_devices' on Instance uuid cab97f26-4bc8-4d68-88b9-c3fc6932d88a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:38:23 user nova-compute[72998]:   <uuid>cab97f26-4bc8-4d68-88b9-c3fc6932d88a</uuid>
Aug 17 08:38:23 user nova-compute[72998]:   <name>instance-00000025</name>
Aug 17 08:38:23 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:38:23 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:38:23 user nova-compute[72998]:   <metadata>
Aug 17 08:38:23 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:38:23 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:38:23 user nova-compute[72998]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1309825375</nova:name>
Aug 17 08:38:23 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:38:23</nova:creationTime>
Aug 17 08:38:23 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:38:23 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:38:23 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:38:23 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:38:23 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:38:23 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:38:23 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:38:23 user nova-compute[72998]:       <nova:owner>
Aug 17 08:38:23 user nova-compute[72998]:         <nova:user uuid="e2bda65353ee4488b74eda92e0d383e7">tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member</nova:user>
Aug 17 08:38:23 user nova-compute[72998]:         <nova:project uuid="ffbb3156666b476f860039288c6b69c0">tempest-TestServerVolumeAttachScenarioOldVersion-1045382181</nova:project>
Aug 17 08:38:23 user nova-compute[72998]:       </nova:owner>
Aug 17 08:38:23 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:38:23 user nova-compute[72998]:       <nova:ports>
Aug 17 08:38:23 user nova-compute[72998]:         <nova:port uuid="03247e13-2cbf-4cb9-a54f-8f06c4a9abf3">
Aug 17 08:38:23 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:38:23 user nova-compute[72998]:         </nova:port>
Aug 17 08:38:23 user nova-compute[72998]:       </nova:ports>
Aug 17 08:38:23 user nova-compute[72998]:     </nova:instance>
Aug 17 08:38:23 user nova-compute[72998]:   </metadata>
Aug 17 08:38:23 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:38:23 user nova-compute[72998]:     <system>
Aug 17 08:38:23 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:38:23 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:38:23 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:38:23 user nova-compute[72998]:       <entry name="serial">cab97f26-4bc8-4d68-88b9-c3fc6932d88a</entry>
Aug 17 08:38:23 user nova-compute[72998]:       <entry name="uuid">cab97f26-4bc8-4d68-88b9-c3fc6932d88a</entry>
Aug 17 08:38:23 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:38:23 user nova-compute[72998]:     </system>
Aug 17 08:38:23 user nova-compute[72998]:   </sysinfo>
Aug 17 08:38:23 user nova-compute[72998]:   <os>
Aug 17 08:38:23 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:38:23 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:38:23 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:38:23 user nova-compute[72998]:   </os>
Aug 17 08:38:23 user nova-compute[72998]:   <features>
Aug 17 08:38:23 user nova-compute[72998]:     <acpi/>
Aug 17 08:38:23 user nova-compute[72998]:     <apic/>
Aug 17 08:38:23 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:38:23 user nova-compute[72998]:   </features>
Aug 17 08:38:23 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:38:23 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:38:23 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:38:23 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:38:23 user nova-compute[72998]:   </clock>
Aug 17 08:38:23 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:38:23 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:38:23 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:38:23 user nova-compute[72998]:   </cpu>
Aug 17 08:38:23 user nova-compute[72998]:   <devices>
Aug 17 08:38:23 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:38:23 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:38:23 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk"/>
Aug 17 08:38:23 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:38:23 user nova-compute[72998]:     </disk>
Aug 17 08:38:23 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:38:23 user nova-compute[72998]:       <mac address="fa:16:3e:f0:f4:c7"/>
Aug 17 08:38:23 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:38:23 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:38:23 user nova-compute[72998]:       <target dev="tap03247e13-2c"/>
Aug 17 08:38:23 user nova-compute[72998]:     </interface>
Aug 17 08:38:23 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:38:23 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/console.log" append="off"/>
Aug 17 08:38:23 user nova-compute[72998]:     </serial>
Aug 17 08:38:23 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:38:23 user nova-compute[72998]:     <video>
Aug 17 08:38:23 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:38:23 user nova-compute[72998]:     </video>
Aug 17 08:38:23 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:38:23 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:38:23 user nova-compute[72998]:     </rng>
Aug 17 08:38:23 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:38:23 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:38:23 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:38:23 user nova-compute[72998]:     </memballoon>
Aug 17 08:38:23 user nova-compute[72998]:   </devices>
Aug 17 08:38:23 user nova-compute[72998]: </domain>
Aug 17 08:38:23 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1309825375',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1309825375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1309825',id=37,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExFIemO1KKIe47qEPIBGGzWQbGniVasX2PbD8+McGV3iK1/QVVJwKLO9PBhsU3OtYr/jw8Wow8puUsYBlXbPKowbhzRVz/y4tScgiYOowUWDwJkrd6upEsSVSElsQAnoQ==',key_name='tempest-keypair-683687485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffbb3156666b476f860039288c6b69c0',ramdisk_id='',reservation_id='r-fte5qlz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1045382181',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2bda65353ee4488b74eda92e0d383e7',uuid=cab97f26-4bc8-4d68-88b9-c3fc6932d88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Converting VIF {"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f4:c7,bridge_name='br-int',has_traffic_filtering=True,id=03247e13-2cbf-4cb9-a54f-8f06c4a9abf3,network=Network(c1d53fc8-c48b-4bf7-81de-1645f1f18d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247e13-2c') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG os_vif [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f4:c7,bridge_name='br-int',has_traffic_filtering=True,id=03247e13-2cbf-4cb9-a54f-8f06c4a9abf3,network=Network(c1d53fc8-c48b-4bf7-81de-1645f1f18d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247e13-2c') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03247e13-2c, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03247e13-2c, col_values=(('external_ids', {'iface-id': '03247e13-2cbf-4cb9-a54f-8f06c4a9abf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:f4:c7', 'vm-uuid': 'cab97f26-4bc8-4d68-88b9-c3fc6932d88a'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:23 user nova-compute[72998]: INFO os_vif [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f4:c7,bridge_name='br-int',has_traffic_filtering=True,id=03247e13-2cbf-4cb9-a54f-8f06c4a9abf3,network=Network(c1d53fc8-c48b-4bf7-81de-1645f1f18d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247e13-2c')
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] No VIF found with MAC fa:16:3e:f0:f4:c7, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.network.neutron [req-7b724930-8fd0-4054-8e36-2129de19e7ee req-63a922ae-ac2a-49db-9825-27e8e43d344a service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Updated VIF entry in instance network info cache for port 03247e13-2cbf-4cb9-a54f-8f06c4a9abf3. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG nova.network.neutron [req-7b724930-8fd0-4054-8e36-2129de19e7ee req-63a922ae-ac2a-49db-9825-27e8e43d344a service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Updating instance_info_cache with network_info: [{"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7b724930-8fd0-4054-8e36-2129de19e7ee req-63a922ae-ac2a-49db-9825-27e8e43d344a service nova] Releasing lock "refresh_cache-cab97f26-4bc8-4d68-88b9-c3fc6932d88a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:38:23 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-49525949-9784-4cb2-b73b-f96f13f768a0 req-41afb312-24b1-4764-9f23-d4084bf3f6a8 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received event network-vif-plugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-49525949-9784-4cb2-b73b-f96f13f768a0 req-41afb312-24b1-4764-9f23-d4084bf3f6a8 service nova] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-49525949-9784-4cb2-b73b-f96f13f768a0 req-41afb312-24b1-4764-9f23-d4084bf3f6a8 service nova] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-49525949-9784-4cb2-b73b-f96f13f768a0 req-41afb312-24b1-4764-9f23-d4084bf3f6a8 service nova] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-49525949-9784-4cb2-b73b-f96f13f768a0 req-41afb312-24b1-4764-9f23-d4084bf3f6a8 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] No waiting events found dispatching network-vif-plugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:38:24 user nova-compute[72998]: WARNING nova.compute.manager [req-49525949-9784-4cb2-b73b-f96f13f768a0 req-41afb312-24b1-4764-9f23-d4084bf3f6a8 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received unexpected event network-vif-plugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 for instance with vm_state building and task_state spawning.
Aug 17 08:38:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261506.622909, cab97f26-4bc8-4d68-88b9-c3fc6932d88a => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:38:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] VM Resumed (Lifecycle Event)
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:38:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Instance spawned successfully.
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:38:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261506.6261203, cab97f26-4bc8-4d68-88b9-c3fc6932d88a => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:38:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] VM Started (Lifecycle Event)
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:38:26 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-f12fb842-b463-4e83-aa0d-7fddafa5bda3 req-87f4c2bf-5524-49f0-a3a1-875e56cd0fad service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received event network-vif-plugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f12fb842-b463-4e83-aa0d-7fddafa5bda3 req-87f4c2bf-5524-49f0-a3a1-875e56cd0fad service nova] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f12fb842-b463-4e83-aa0d-7fddafa5bda3 req-87f4c2bf-5524-49f0-a3a1-875e56cd0fad service nova] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f12fb842-b463-4e83-aa0d-7fddafa5bda3 req-87f4c2bf-5524-49f0-a3a1-875e56cd0fad service nova] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-f12fb842-b463-4e83-aa0d-7fddafa5bda3 req-87f4c2bf-5524-49f0-a3a1-875e56cd0fad service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] No waiting events found dispatching network-vif-plugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:38:26 user nova-compute[72998]: WARNING nova.compute.manager [req-f12fb842-b463-4e83-aa0d-7fddafa5bda3 req-87f4c2bf-5524-49f0-a3a1-875e56cd0fad service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received unexpected event network-vif-plugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 for instance with vm_state building and task_state spawning.
Aug 17 08:38:26 user nova-compute[72998]: INFO nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 17 08:38:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:38:26 user nova-compute[72998]: INFO nova.compute.manager [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Took 6.85 seconds to build instance.
Aug 17 08:38:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb3c9991-2af0-48ef-a935-45847873d367 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.951s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:31 user nova-compute[72998]: INFO nova.compute.manager [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Terminating instance
Aug 17 08:38:31 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-0358dd76-9ad4-4dfd-8827-00824ec8a742 req-3fe4ceb6-c4f8-42f9-b4b9-bfc796402f9f service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-unplugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0358dd76-9ad4-4dfd-8827-00824ec8a742 req-3fe4ceb6-c4f8-42f9-b4b9-bfc796402f9f service nova] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0358dd76-9ad4-4dfd-8827-00824ec8a742 req-3fe4ceb6-c4f8-42f9-b4b9-bfc796402f9f service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0358dd76-9ad4-4dfd-8827-00824ec8a742 req-3fe4ceb6-c4f8-42f9-b4b9-bfc796402f9f service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-0358dd76-9ad4-4dfd-8827-00824ec8a742 req-3fe4ceb6-c4f8-42f9-b4b9-bfc796402f9f service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] No waiting events found dispatching network-vif-unplugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-0358dd76-9ad4-4dfd-8827-00824ec8a742 req-3fe4ceb6-c4f8-42f9-b4b9-bfc796402f9f service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-unplugged-f16d574a-29ef-48bf-ad01-e265b40230e9 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:38:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Instance destroyed successfully.
Aug 17 08:38:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lazy-loading 'resources' on Instance uuid 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1204377761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-373519911',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAXiPkoFsXDsszomH4a9tiB8HL1Q+bw4C9LQroNiBYVkTwJmVfrYdjrMYHaRjACSIyjiNtavkgq7vxeh9nR4rRVtOwBdAR2qonBhGQBGb0c3M8+WtbliPvywE6AH7wbTA==',key_name='tempest-keypair-1902106096',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='854d040e58e2418398176f53fd728654',ramdisk_id='',reservation_id='r-u3a3dveb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1189732577',owner_user_name='tempest-ServerActionsV293TestJSON-1189732577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d26b8d5e31fc4b2aaba3ea57936cc6cb',uuid=66cb9c6d-7132-45ef-bb88-2c8b1f13fff1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converting VIF {"id": "f16d574a-29ef-48bf-ad01-e265b40230e9", "address": "fa:16:3e:59:14:4d", "network": {"id": "399d42b7-81a4-4460-bfba-07effdb25216", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2135506523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "854d040e58e2418398176f53fd728654", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d574a-29", "ovs_interfaceid": "f16d574a-29ef-48bf-ad01-e265b40230e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG os_vif [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf16d574a-29, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:38:31 user nova-compute[72998]: INFO os_vif [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:14:4d,bridge_name='br-int',has_traffic_filtering=True,id=f16d574a-29ef-48bf-ad01-e265b40230e9,network=Network(399d42b7-81a4-4460-bfba-07effdb25216),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d574a-29')
Aug 17 08:38:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBxdFnyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:38:31 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:38:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ff3fb7-e800-4bb0-9360-8d048b15d19b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38d52b5-af81-403d-b8e2-0a55c9756e6a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:38:32 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:38:32 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:38:32 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:38:32 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:38:32 user nova-compute[72998]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e (non-flash)
Aug 17 08:38:32 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4883bbd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e'): ({'sde'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Removing single pathed devices sde {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16aaef-9e75-403f-a3db-1fadfcb3bc80]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd79c85-8a9a-4b76-94ea-20339ae47bf1]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Flushing IO for device /dev/sde {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f233d2e7-ef8e-4bf0-8a10-1d7a669cf1dd]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d5ab2f-503b-4257-b4b1-fef98955ceb0]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] SCSI volumes sde have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c752acbe',) {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[04271f40-2572-4196-a296-825956acb8d9]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1a696a-671f-41cb-a378-d7e3f5042228]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a42da27-3c66-456b-a410-b1913a653cc8]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260]
Aug 17 08:38:32 user nova-compute[72998]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e, portal: 172.16.0.220,3260] successful.
Aug 17 08:38:32 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef96c9bc-b3c3-4285-98f7-b70ad91aed0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b0e3a0-722b-48f3-966a-3eae86bd9fa6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] <== disconnect_volume: return (337ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:38:32 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Deleting instance files /opt/stack/data/nova/instances/66cb9c6d-7132-45ef-bb88-2c8b1f13fff1_del
Aug 17 08:38:32 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Deletion of /opt/stack/data/nova/instances/66cb9c6d-7132-45ef-bb88-2c8b1f13fff1_del complete
Aug 17 08:38:32 user nova-compute[72998]: INFO nova.compute.manager [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 17 08:38:32 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:38:32 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:38:33 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:38:33 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Took 0.96 seconds to deallocate network for instance.
Aug 17 08:38:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-6629b49d-b88d-4dbb-8a98-3ae8d320801c req-2d5fe013-590f-408e-ad32-09031a661f02 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-deleted-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:38:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-4744ea3f-55d7-4cba-a6a6-0e5dc71b726b req-5f2bb1aa-f32d-4518-b3b4-199a00ea7066 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:38:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4744ea3f-55d7-4cba-a6a6-0e5dc71b726b req-5f2bb1aa-f32d-4518-b3b4-199a00ea7066 service nova] Acquiring lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4744ea3f-55d7-4cba-a6a6-0e5dc71b726b req-5f2bb1aa-f32d-4518-b3b4-199a00ea7066 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4744ea3f-55d7-4cba-a6a6-0e5dc71b726b req-5f2bb1aa-f32d-4518-b3b4-199a00ea7066 service nova] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-4744ea3f-55d7-4cba-a6a6-0e5dc71b726b req-5f2bb1aa-f32d-4518-b3b4-199a00ea7066 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] No waiting events found dispatching network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:38:33 user nova-compute[72998]: WARNING nova.compute.manager [req-4744ea3f-55d7-4cba-a6a6-0e5dc71b726b req-5f2bb1aa-f32d-4518-b3b4-199a00ea7066 service nova] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Received unexpected event network-vif-plugged-f16d574a-29ef-48bf-ad01-e265b40230e9 for instance with vm_state active and task_state deleting.
Aug 17 08:38:34 user nova-compute[72998]: INFO nova.compute.manager [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 08:38:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Deleting volume: ef96c9bc-b3c3-4285-98f7-b70ad91aed0e {{(pid=72998) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 08:38:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:38:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:38:34 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:38:34 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:38:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:34 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Deleted allocations for instance 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1
Aug 17 08:38:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4d2dca8e-09e3-4f3f-a5c5-04f9c3c2b1dc tempest-ServerActionsV293TestJSON-1189732577 tempest-ServerActionsV293TestJSON-1189732577-project-member] Lock "66cb9c6d-7132-45ef-bb88-2c8b1f13fff1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.545s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:38:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:46 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261511.9092755, 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:38:46 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] VM Stopped (Lifecycle Event)
Aug 17 08:38:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fe1dd672-a798-4315-8a52-e0adeab5ba42 None None] [instance: 66cb9c6d-7132-45ef-bb88-2c8b1f13fff1] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:38:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:38:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:39:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:39:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:39:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:39:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:39:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:39:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:39:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:39:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:39:12 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:39:12 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:39:13 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updating instance_info_cache with network_info: [{"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:39:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:39:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:39:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:39:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:16 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:39:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:17 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:19 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:39:19 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=23.927391052246094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d6089253-9a85-4d00-82f9-950660857b54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cab97f26-4bc8-4d68-88b9-c3fc6932d88a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:39:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:39:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:39:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:22 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:39:22 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:39:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:39:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:39:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:39:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:39:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d6089253-9a85-4d00-82f9-950660857b54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:33 user nova-compute[72998]: INFO nova.compute.manager [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Terminating instance
Aug 17 08:39:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-1cdea757-3c15-410c-9cc9-0f70a631e5c2 req-3b221fa1-5c2b-485c-9c6b-02a6bfba4c95 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-unplugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1cdea757-3c15-410c-9cc9-0f70a631e5c2 req-3b221fa1-5c2b-485c-9c6b-02a6bfba4c95 service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1cdea757-3c15-410c-9cc9-0f70a631e5c2 req-3b221fa1-5c2b-485c-9c6b-02a6bfba4c95 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1cdea757-3c15-410c-9cc9-0f70a631e5c2 req-3b221fa1-5c2b-485c-9c6b-02a6bfba4c95 service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-1cdea757-3c15-410c-9cc9-0f70a631e5c2 req-3b221fa1-5c2b-485c-9c6b-02a6bfba4c95 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-unplugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-1cdea757-3c15-410c-9cc9-0f70a631e5c2 req-3b221fa1-5c2b-485c-9c6b-02a6bfba4c95 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-unplugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] Instance destroyed successfully.
Aug 17 08:39:34 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'resources' on Instance uuid d6089253-9a85-4d00-82f9-950660857b54 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1027641458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1027641458',id=33,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:35:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-3nym79wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:37:48Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=d6089253-9a85-4d00-82f9-950660857b54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "address": "fa:16:3e:33:0d:43", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e8bfc2-55", "ovs_interfaceid": "c5e8bfc2-5587-4650-a5d0-af67de1044bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:0d:43,bridge_name='br-int',has_traffic_filtering=True,id=c5e8bfc2-5587-4650-a5d0-af67de1044bb,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e8bfc2-55') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_vif [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:0d:43,bridge_name='br-int',has_traffic_filtering=True,id=c5e8bfc2-5587-4650-a5d0-af67de1044bb,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e8bfc2-55') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5e8bfc2-55, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:39:34 user nova-compute[72998]: INFO os_vif [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:0d:43,bridge_name='br-int',has_traffic_filtering=True,id=c5e8bfc2-5587-4650-a5d0-af67de1044bb,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e8bfc2-55')
Aug 17 08:39:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amhEwoqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:39:34 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dbad9d-2530-4825-a241-5b90d17e5dd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba29701-9692-4915-9422-8deb6da0ab15]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:39:34 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:39:34 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:39:34 user nova-compute[72998]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 (non-flash)
Aug 17 08:39:34 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa48824e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[911f1184-aff6-4492-a4cd-c21c633a8370]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a840034-65b8-46d1-8976-00e68bbed7d9]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df20f37-ee35-49be-9587-acce0545b94d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe1463a-9ea3-456b-84ba-32854e7a2882]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3df1c19',) {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[14869bee-269f-488b-b061-28cb6e03381a]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[944d4aa1-6071-4abb-b9ab-c483a52c8161]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cabe42-2352-40fb-aa49-0a4f31cf42f9]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3, portal: 172.16.0.220,3260]
Aug 17 08:39:34 user nova-compute[72998]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3, portal: 172.16.0.220,3260] successful.
Aug 17 08:39:34 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f919e88-0e8b-41ac-8b02-7fea832df6a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d771851b-2a93-439a-a704-e0ce126ce4e5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] <== disconnect_volume: return (333ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:39:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Deleting instance files /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54_del
Aug 17 08:39:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Deletion of /opt/stack/data/nova/instances/d6089253-9a85-4d00-82f9-950660857b54_del complete
Aug 17 08:39:34 user nova-compute[72998]: INFO nova.compute.manager [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 17 08:39:34 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:39:34 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:39:35 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:39:35 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] Took 0.89 seconds to deallocate network for instance.
Aug 17 08:39:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-adc3da2a-c6c8-4ae2-b990-61bbf23df45a req-e9399edc-3647-4604-a241-d626f94782c4 service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-deleted-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:39:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-314f3257-3a43-464e-8549-5ef3e2148afa req-450ce3fc-ce82-4371-abd0-0046d57788ab service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:39:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-314f3257-3a43-464e-8549-5ef3e2148afa req-450ce3fc-ce82-4371-abd0-0046d57788ab service nova] Acquiring lock "d6089253-9a85-4d00-82f9-950660857b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-314f3257-3a43-464e-8549-5ef3e2148afa req-450ce3fc-ce82-4371-abd0-0046d57788ab service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-314f3257-3a43-464e-8549-5ef3e2148afa req-450ce3fc-ce82-4371-abd0-0046d57788ab service nova] Lock "d6089253-9a85-4d00-82f9-950660857b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-314f3257-3a43-464e-8549-5ef3e2148afa req-450ce3fc-ce82-4371-abd0-0046d57788ab service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] No waiting events found dispatching network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:39:35 user nova-compute[72998]: WARNING nova.compute.manager [req-314f3257-3a43-464e-8549-5ef3e2148afa req-450ce3fc-ce82-4371-abd0-0046d57788ab service nova] [instance: d6089253-9a85-4d00-82f9-950660857b54] Received unexpected event network-vif-plugged-c5e8bfc2-5587-4650-a5d0-af67de1044bb for instance with vm_state active and task_state deleting.
Aug 17 08:39:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:39:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:39:36 user nova-compute[72998]: INFO nova.compute.claims [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Claim successful on node user
Aug 17 08:39:36 user nova-compute[72998]: INFO nova.compute.manager [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d6089253-9a85-4d00-82f9-950660857b54] Took 0.95 seconds to detach 1 volumes for instance.
Aug 17 08:39:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:36 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:39:36 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.202s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:39:37 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:39:37 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Creating image(s)
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "/opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "/opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "/opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.policy [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad6fa0f0675942b18c911f61e39bf71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2b81f590b4c05bde54a7669412ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.236s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:37 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Deleted allocations for instance d6089253-9a85-4d00-82f9-950660857b54
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be1f3438-e444-4222-9a2a-a0498a6a4770 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d6089253-9a85-4d00-82f9-950660857b54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.051s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.200s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk 1073741824" returned: 0 in 0.061s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:39:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:38 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Cannot resize image /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:39:38 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'migration_context' on Instance uuid 22883775-aeb8-473a-aae4-2120cb980709 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:39:38 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:39:38 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Ensure instance console log exists: /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:39:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:38 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Successfully created port: 81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:39:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Successfully updated port: 81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquired lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-7f36ed30-e4d4-464e-8f31-7a79618debc0 req-0340118e-1f2a-4746-a7f2-d8802a7101b4 service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received event network-changed-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-7f36ed30-e4d4-464e-8f31-7a79618debc0 req-0340118e-1f2a-4746-a7f2-d8802a7101b4 service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Refreshing instance network info cache due to event network-changed-81a89519-bb86-4e57-b971-eb1b3237b1f7. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7f36ed30-e4d4-464e-8f31-7a79618debc0 req-0340118e-1f2a-4746-a7f2-d8802a7101b4 service nova] Acquiring lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updating instance_info_cache with network_info: [{"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Releasing lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Instance network_info: |[{"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7f36ed30-e4d4-464e-8f31-7a79618debc0 req-0340118e-1f2a-4746-a7f2-d8802a7101b4 service nova] Acquired lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.neutron [req-7f36ed30-e4d4-464e-8f31-7a79618debc0 req-0340118e-1f2a-4746-a7f2-d8802a7101b4 service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Refreshing network info cache for port 81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Start _get_guest_xml network_info=[{"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:39:40 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:39:40 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1397220662',display_name='tempest-AttachVolumeNegativeTest-server-1397220662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1397220662',id=38,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIwqsz/fERzeovg68Q86Gs2cOjFPSdJ7WSYqxQFpOTkIWVhEugLAhbOTMVfRvmAbN9sTAuktU8oHKUKBuod1w7yu26TbL/UbIpG960woi2P+CtYHHjZudePOp5T2MQVQg==',key_name='tempest-keypair-1826111675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-25fzoru2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=22883775-aeb8-473a-aae4-2120cb980709,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:88:f4,bridge_name='br-int',has_traffic_filtering=True,id=81a89519-bb86-4e57-b971-eb1b3237b1f7,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a89519-bb') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'pci_devices' on Instance uuid 22883775-aeb8-473a-aae4-2120cb980709 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:39:40 user nova-compute[72998]:   <uuid>22883775-aeb8-473a-aae4-2120cb980709</uuid>
Aug 17 08:39:40 user nova-compute[72998]:   <name>instance-00000026</name>
Aug 17 08:39:40 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:39:40 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:39:40 user nova-compute[72998]:   <metadata>
Aug 17 08:39:40 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:39:40 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:39:40 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1397220662</nova:name>
Aug 17 08:39:40 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:39:40</nova:creationTime>
Aug 17 08:39:40 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:39:40 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:39:40 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:39:40 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:39:40 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:39:40 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:39:40 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:39:40 user nova-compute[72998]:       <nova:owner>
Aug 17 08:39:40 user nova-compute[72998]:         <nova:user uuid="ad6fa0f0675942b18c911f61e39bf71d">tempest-AttachVolumeNegativeTest-1248035146-project-member</nova:user>
Aug 17 08:39:40 user nova-compute[72998]:         <nova:project uuid="91f2b81f590b4c05bde54a7669412ac3">tempest-AttachVolumeNegativeTest-1248035146</nova:project>
Aug 17 08:39:40 user nova-compute[72998]:       </nova:owner>
Aug 17 08:39:40 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:39:40 user nova-compute[72998]:       <nova:ports>
Aug 17 08:39:40 user nova-compute[72998]:         <nova:port uuid="81a89519-bb86-4e57-b971-eb1b3237b1f7">
Aug 17 08:39:40 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:39:40 user nova-compute[72998]:         </nova:port>
Aug 17 08:39:40 user nova-compute[72998]:       </nova:ports>
Aug 17 08:39:40 user nova-compute[72998]:     </nova:instance>
Aug 17 08:39:40 user nova-compute[72998]:   </metadata>
Aug 17 08:39:40 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:39:40 user nova-compute[72998]:     <system>
Aug 17 08:39:40 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:39:40 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:39:40 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:39:40 user nova-compute[72998]:       <entry name="serial">22883775-aeb8-473a-aae4-2120cb980709</entry>
Aug 17 08:39:40 user nova-compute[72998]:       <entry name="uuid">22883775-aeb8-473a-aae4-2120cb980709</entry>
Aug 17 08:39:40 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:39:40 user nova-compute[72998]:     </system>
Aug 17 08:39:40 user nova-compute[72998]:   </sysinfo>
Aug 17 08:39:40 user nova-compute[72998]:   <os>
Aug 17 08:39:40 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:39:40 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:39:40 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:39:40 user nova-compute[72998]:   </os>
Aug 17 08:39:40 user nova-compute[72998]:   <features>
Aug 17 08:39:40 user nova-compute[72998]:     <acpi/>
Aug 17 08:39:40 user nova-compute[72998]:     <apic/>
Aug 17 08:39:40 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:39:40 user nova-compute[72998]:   </features>
Aug 17 08:39:40 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:39:40 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:39:40 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:39:40 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:39:40 user nova-compute[72998]:   </clock>
Aug 17 08:39:40 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:39:40 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:39:40 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:39:40 user nova-compute[72998]:   </cpu>
Aug 17 08:39:40 user nova-compute[72998]:   <devices>
Aug 17 08:39:40 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:39:40 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:39:40 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk"/>
Aug 17 08:39:40 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:39:40 user nova-compute[72998]:     </disk>
Aug 17 08:39:40 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:39:40 user nova-compute[72998]:       <mac address="fa:16:3e:8f:88:f4"/>
Aug 17 08:39:40 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:39:40 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:39:40 user nova-compute[72998]:       <target dev="tap81a89519-bb"/>
Aug 17 08:39:40 user nova-compute[72998]:     </interface>
Aug 17 08:39:40 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:39:40 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/console.log" append="off"/>
Aug 17 08:39:40 user nova-compute[72998]:     </serial>
Aug 17 08:39:40 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:39:40 user nova-compute[72998]:     <video>
Aug 17 08:39:40 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:39:40 user nova-compute[72998]:     </video>
Aug 17 08:39:40 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:39:40 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:39:40 user nova-compute[72998]:     </rng>
Aug 17 08:39:40 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:39:40 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:39:40 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:39:40 user nova-compute[72998]:     </memballoon>
Aug 17 08:39:40 user nova-compute[72998]:   </devices>
Aug 17 08:39:40 user nova-compute[72998]: </domain>
Aug 17 08:39:40 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1397220662',display_name='tempest-AttachVolumeNegativeTest-server-1397220662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1397220662',id=38,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIwqsz/fERzeovg68Q86Gs2cOjFPSdJ7WSYqxQFpOTkIWVhEugLAhbOTMVfRvmAbN9sTAuktU8oHKUKBuod1w7yu26TbL/UbIpG960woi2P+CtYHHjZudePOp5T2MQVQg==',key_name='tempest-keypair-1826111675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-25fzoru2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=22883775-aeb8-473a-aae4-2120cb980709,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:88:f4,bridge_name='br-int',has_traffic_filtering=True,id=81a89519-bb86-4e57-b971-eb1b3237b1f7,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a89519-bb') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG os_vif [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:88:f4,bridge_name='br-int',has_traffic_filtering=True,id=81a89519-bb86-4e57-b971-eb1b3237b1f7,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a89519-bb') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81a89519-bb, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81a89519-bb, col_values=(('external_ids', {'iface-id': '81a89519-bb86-4e57-b971-eb1b3237b1f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:88:f4', 'vm-uuid': '22883775-aeb8-473a-aae4-2120cb980709'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:40 user nova-compute[72998]: INFO os_vif [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:88:f4,bridge_name='br-int',has_traffic_filtering=True,id=81a89519-bb86-4e57-b971-eb1b3237b1f7,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a89519-bb')
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No VIF found with MAC fa:16:3e:8f:88:f4, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.neutron [req-7f36ed30-e4d4-464e-8f31-7a79618debc0 req-0340118e-1f2a-4746-a7f2-d8802a7101b4 service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updated VIF entry in instance network info cache for port 81a89519-bb86-4e57-b971-eb1b3237b1f7. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG nova.network.neutron [req-7f36ed30-e4d4-464e-8f31-7a79618debc0 req-0340118e-1f2a-4746-a7f2-d8802a7101b4 service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updating instance_info_cache with network_info: [{"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:39:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7f36ed30-e4d4-464e-8f31-7a79618debc0 req-0340118e-1f2a-4746-a7f2-d8802a7101b4 service nova] Releasing lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:39:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-0afe79f7-7e90-423d-8753-175e56176f6c req-41be34a8-14db-4292-b001-1f189479455a service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received event network-vif-plugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:39:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0afe79f7-7e90-423d-8753-175e56176f6c req-41be34a8-14db-4292-b001-1f189479455a service nova] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0afe79f7-7e90-423d-8753-175e56176f6c req-41be34a8-14db-4292-b001-1f189479455a service nova] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0afe79f7-7e90-423d-8753-175e56176f6c req-41be34a8-14db-4292-b001-1f189479455a service nova] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-0afe79f7-7e90-423d-8753-175e56176f6c req-41be34a8-14db-4292-b001-1f189479455a service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] No waiting events found dispatching network-vif-plugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:39:42 user nova-compute[72998]: WARNING nova.compute.manager [req-0afe79f7-7e90-423d-8753-175e56176f6c req-41be34a8-14db-4292-b001-1f189479455a service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received unexpected event network-vif-plugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 for instance with vm_state building and task_state spawning.
Aug 17 08:39:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261584.1160998, 22883775-aeb8-473a-aae4-2120cb980709 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:39:44 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] VM Resumed (Lifecycle Event)
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:39:44 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Instance spawned successfully.
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:44 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261584.120382, 22883775-aeb8-473a-aae4-2120cb980709 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:39:44 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] VM Started (Lifecycle Event)
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-4645c057-9d0d-4316-a61a-8c8a569671e8 req-bb1d9704-e781-4722-9cb0-ad0738cf94bd service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received event network-vif-plugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4645c057-9d0d-4316-a61a-8c8a569671e8 req-bb1d9704-e781-4722-9cb0-ad0738cf94bd service nova] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4645c057-9d0d-4316-a61a-8c8a569671e8 req-bb1d9704-e781-4722-9cb0-ad0738cf94bd service nova] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4645c057-9d0d-4316-a61a-8c8a569671e8 req-bb1d9704-e781-4722-9cb0-ad0738cf94bd service nova] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.compute.manager [req-4645c057-9d0d-4316-a61a-8c8a569671e8 req-bb1d9704-e781-4722-9cb0-ad0738cf94bd service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] No waiting events found dispatching network-vif-plugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:39:44 user nova-compute[72998]: WARNING nova.compute.manager [req-4645c057-9d0d-4316-a61a-8c8a569671e8 req-bb1d9704-e781-4722-9cb0-ad0738cf94bd service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received unexpected event network-vif-plugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 for instance with vm_state building and task_state spawning.
Aug 17 08:39:44 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:39:44 user nova-compute[72998]: INFO nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Took 7.07 seconds to spawn the instance on the hypervisor.
Aug 17 08:39:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:39:44 user nova-compute[72998]: INFO nova.compute.manager [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Took 7.77 seconds to build instance.
Aug 17 08:39:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8ff5614c-95d1-4d10-99a8-d9b94216f684 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.863s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:49 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261574.454441, d6089253-9a85-4d00-82f9-950660857b54 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:39:49 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: d6089253-9a85-4d00-82f9-950660857b54] VM Stopped (Lifecycle Event)
Aug 17 08:39:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-35624bec-d287-4807-ae7e-078cf1f850eb None None] [instance: d6089253-9a85-4d00-82f9-950660857b54] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:39:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:39:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:52 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:39:52 user nova-compute[72998]: INFO nova.compute.claims [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Claim successful on node user
Aug 17 08:39:53 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:39:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:39:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG nova.policy [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05f5c4078974746b66bfa8506bdd7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd77c6b0783945e8b87fa60b07e5232b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:39:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Creating image(s)
Aug 17 08:39:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "/opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "/opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "688433afa192822b2f15a11a34097485dc6c7429" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "688433afa192822b2f15a11a34097485dc6c7429" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429.part --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG nova.virt.images [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] 66c3b1d6-0c2a-4db7-8805-923c58b2adde was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429.part /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Successfully created port: 51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429.part /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429.converted" returned: 0 in 0.309s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "688433afa192822b2f15a11a34097485dc6c7429" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.231s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 --force-share --output=json" returned: 0 in 0.206s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "688433afa192822b2f15a11a34097485dc6c7429" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "688433afa192822b2f15a11a34097485dc6c7429" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429,backing_fmt=raw /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429,backing_fmt=raw /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk 1073741824" returned: 0 in 0.098s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "688433afa192822b2f15a11a34097485dc6c7429" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Successfully updated port: 51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquired lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-1a044a07-9824-4266-b9a9-94e3e2f14790 req-cc76327a-e0bf-43a6-b0f3-fb144dc1d7d4 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-changed-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-1a044a07-9824-4266-b9a9-94e3e2f14790 req-cc76327a-e0bf-43a6-b0f3-fb144dc1d7d4 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing instance network info cache due to event network-changed-51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1a044a07-9824-4266-b9a9-94e3e2f14790 req-cc76327a-e0bf-43a6-b0f3-fb144dc1d7d4 service nova] Acquiring lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 --force-share --output=json" returned: 0 in 0.171s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Cannot resize image /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'migration_context' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Ensure instance console log exists: /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Releasing lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Instance network_info: |[{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1a044a07-9824-4266-b9a9-94e3e2f14790 req-cc76327a-e0bf-43a6-b0f3-fb144dc1d7d4 service nova] Acquired lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.network.neutron [req-1a044a07-9824-4266-b9a9-94e3e2f14790 req-cc76327a-e0bf-43a6-b0f3-fb144dc1d7d4 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Start _get_guest_xml network_info=[{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:39:50Z,direct_url=<?>,disk_format='qcow2',id=66c3b1d6-0c2a-4db7-8805-923c58b2adde,min_disk=0,min_ram=0,name='tempest-scenario-img--95454683',owner='cd77c6b0783945e8b87fa60b07e5232b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:39:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '66c3b1d6-0c2a-4db7-8805-923c58b2adde'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:39:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:39:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:39:50Z,direct_url=<?>,disk_format='qcow2',id=66c3b1d6-0c2a-4db7-8805-923c58b2adde,min_disk=0,min_ram=0,name='tempest-scenario-img--95454683',owner='cd77c6b0783945e8b87fa60b07e5232b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:39:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:39:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-338776735',display_name='tempest-TestMinimumBasicScenario-server-338776735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-338776735',id=39,image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvq2WNCTBYqBGuVWNmRO44oTXAGMUF6L7WNC8G5hcHlzClI4sQ6k9sVH9+bSyVWT3TIxX8+TweUWKfWKnn07FwLThKeZM7Uot2bjKbLCBVQFoWMZ6XV31ArdBk1Ga5Mg==',key_name='tempest-TestMinimumBasicScenario-735319624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd77c6b0783945e8b87fa60b07e5232b',ramdisk_id='',reservation_id='r-5rc8avyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2058599716',owner_user_name='tempest-TestMinimumBasicScenario-2058599716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:39:54Z,user_data=None,user_id='d05f5c4078974746b66bfa8506bdd7da',uuid=a1a4ce23-27ae-4109-864e-20dd0fb20a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converting VIF {"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'pci_devices' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:39:56 user nova-compute[72998]:   <uuid>a1a4ce23-27ae-4109-864e-20dd0fb20a28</uuid>
Aug 17 08:39:56 user nova-compute[72998]:   <name>instance-00000027</name>
Aug 17 08:39:56 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:39:56 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:39:56 user nova-compute[72998]:   <metadata>
Aug 17 08:39:56 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:39:56 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:39:56 user nova-compute[72998]:       <nova:name>tempest-TestMinimumBasicScenario-server-338776735</nova:name>
Aug 17 08:39:56 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:39:55</nova:creationTime>
Aug 17 08:39:56 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:39:56 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:39:56 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:39:56 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:39:56 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:39:56 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:39:56 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:39:56 user nova-compute[72998]:       <nova:owner>
Aug 17 08:39:56 user nova-compute[72998]:         <nova:user uuid="d05f5c4078974746b66bfa8506bdd7da">tempest-TestMinimumBasicScenario-2058599716-project-member</nova:user>
Aug 17 08:39:56 user nova-compute[72998]:         <nova:project uuid="cd77c6b0783945e8b87fa60b07e5232b">tempest-TestMinimumBasicScenario-2058599716</nova:project>
Aug 17 08:39:56 user nova-compute[72998]:       </nova:owner>
Aug 17 08:39:56 user nova-compute[72998]:       <nova:root type="image" uuid="66c3b1d6-0c2a-4db7-8805-923c58b2adde"/>
Aug 17 08:39:56 user nova-compute[72998]:       <nova:ports>
Aug 17 08:39:56 user nova-compute[72998]:         <nova:port uuid="51ac5edc-30ee-4886-a432-6be31423371f">
Aug 17 08:39:56 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:39:56 user nova-compute[72998]:         </nova:port>
Aug 17 08:39:56 user nova-compute[72998]:       </nova:ports>
Aug 17 08:39:56 user nova-compute[72998]:     </nova:instance>
Aug 17 08:39:56 user nova-compute[72998]:   </metadata>
Aug 17 08:39:56 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:39:56 user nova-compute[72998]:     <system>
Aug 17 08:39:56 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:39:56 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:39:56 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:39:56 user nova-compute[72998]:       <entry name="serial">a1a4ce23-27ae-4109-864e-20dd0fb20a28</entry>
Aug 17 08:39:56 user nova-compute[72998]:       <entry name="uuid">a1a4ce23-27ae-4109-864e-20dd0fb20a28</entry>
Aug 17 08:39:56 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:39:56 user nova-compute[72998]:     </system>
Aug 17 08:39:56 user nova-compute[72998]:   </sysinfo>
Aug 17 08:39:56 user nova-compute[72998]:   <os>
Aug 17 08:39:56 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:39:56 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:39:56 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:39:56 user nova-compute[72998]:   </os>
Aug 17 08:39:56 user nova-compute[72998]:   <features>
Aug 17 08:39:56 user nova-compute[72998]:     <acpi/>
Aug 17 08:39:56 user nova-compute[72998]:     <apic/>
Aug 17 08:39:56 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:39:56 user nova-compute[72998]:   </features>
Aug 17 08:39:56 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:39:56 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:39:56 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:39:56 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:39:56 user nova-compute[72998]:   </clock>
Aug 17 08:39:56 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:39:56 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:39:56 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:39:56 user nova-compute[72998]:   </cpu>
Aug 17 08:39:56 user nova-compute[72998]:   <devices>
Aug 17 08:39:56 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:39:56 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:39:56 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk"/>
Aug 17 08:39:56 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:39:56 user nova-compute[72998]:     </disk>
Aug 17 08:39:56 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:39:56 user nova-compute[72998]:       <mac address="fa:16:3e:ee:61:9f"/>
Aug 17 08:39:56 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:39:56 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:39:56 user nova-compute[72998]:       <target dev="tap51ac5edc-30"/>
Aug 17 08:39:56 user nova-compute[72998]:     </interface>
Aug 17 08:39:56 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:39:56 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/console.log" append="off"/>
Aug 17 08:39:56 user nova-compute[72998]:     </serial>
Aug 17 08:39:56 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:39:56 user nova-compute[72998]:     <video>
Aug 17 08:39:56 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:39:56 user nova-compute[72998]:     </video>
Aug 17 08:39:56 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:39:56 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:39:56 user nova-compute[72998]:     </rng>
Aug 17 08:39:56 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:39:56 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:39:56 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:39:56 user nova-compute[72998]:     </memballoon>
Aug 17 08:39:56 user nova-compute[72998]:   </devices>
Aug 17 08:39:56 user nova-compute[72998]: </domain>
Aug 17 08:39:56 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-338776735',display_name='tempest-TestMinimumBasicScenario-server-338776735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-338776735',id=39,image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvq2WNCTBYqBGuVWNmRO44oTXAGMUF6L7WNC8G5hcHlzClI4sQ6k9sVH9+bSyVWT3TIxX8+TweUWKfWKnn07FwLThKeZM7Uot2bjKbLCBVQFoWMZ6XV31ArdBk1Ga5Mg==',key_name='tempest-TestMinimumBasicScenario-735319624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd77c6b0783945e8b87fa60b07e5232b',ramdisk_id='',reservation_id='r-5rc8avyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2058599716',owner_user_name='tempest-TestMinimumBasicScenario-2058599716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:39:54Z,user_data=None,user_id='d05f5c4078974746b66bfa8506bdd7da',uuid=a1a4ce23-27ae-4109-864e-20dd0fb20a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converting VIF {"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG os_vif [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51ac5edc-30, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51ac5edc-30, col_values=(('external_ids', {'iface-id': '51ac5edc-30ee-4886-a432-6be31423371f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:61:9f', 'vm-uuid': 'a1a4ce23-27ae-4109-864e-20dd0fb20a28'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:56 user nova-compute[72998]: INFO os_vif [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30')
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No VIF found with MAC fa:16:3e:ee:61:9f, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-1a044a07-9824-4266-b9a9-94e3e2f14790 req-cc76327a-e0bf-43a6-b0f3-fb144dc1d7d4 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updated VIF entry in instance network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG nova.network.neutron [req-1a044a07-9824-4266-b9a9-94e3e2f14790 req-cc76327a-e0bf-43a6-b0f3-fb144dc1d7d4 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:39:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1a044a07-9824-4266-b9a9-94e3e2f14790 req-cc76327a-e0bf-43a6-b0f3-fb144dc1d7d4 service nova] Releasing lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:39:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-a75d030b-8697-48dd-807d-4c4688b962b5 req-51365d0b-f9cc-4d0f-8e82-2e89c60f1305 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:39:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a75d030b-8697-48dd-807d-4c4688b962b5 req-51365d0b-f9cc-4d0f-8e82-2e89c60f1305 service nova] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a75d030b-8697-48dd-807d-4c4688b962b5 req-51365d0b-f9cc-4d0f-8e82-2e89c60f1305 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a75d030b-8697-48dd-807d-4c4688b962b5 req-51365d0b-f9cc-4d0f-8e82-2e89c60f1305 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:57 user nova-compute[72998]: DEBUG nova.compute.manager [req-a75d030b-8697-48dd-807d-4c4688b962b5 req-51365d0b-f9cc-4d0f-8e82-2e89c60f1305 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] No waiting events found dispatching network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:39:57 user nova-compute[72998]: WARNING nova.compute.manager [req-a75d030b-8697-48dd-807d-4c4688b962b5 req-51365d0b-f9cc-4d0f-8e82-2e89c60f1305 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received unexpected event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f for instance with vm_state building and task_state spawning.
Aug 17 08:39:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261599.5168443, a1a4ce23-27ae-4109-864e-20dd0fb20a28 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:39:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] VM Resumed (Lifecycle Event)
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:39:59 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Instance spawned successfully.
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:39:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261599.52022, a1a4ce23-27ae-4109-864e-20dd0fb20a28 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:39:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] VM Started (Lifecycle Event)
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:39:59 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:39:59 user nova-compute[72998]: INFO nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:39:59 user nova-compute[72998]: INFO nova.compute.manager [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Took 6.82 seconds to build instance.
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-31102622-1b45-4749-830a-a8e5195f1b0b req-757a58f4-579c-4e83-abae-88614cc65545 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-31102622-1b45-4749-830a-a8e5195f1b0b req-757a58f4-579c-4e83-abae-88614cc65545 service nova] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-31102622-1b45-4749-830a-a8e5195f1b0b req-757a58f4-579c-4e83-abae-88614cc65545 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-31102622-1b45-4749-830a-a8e5195f1b0b req-757a58f4-579c-4e83-abae-88614cc65545 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:39:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-31102622-1b45-4749-830a-a8e5195f1b0b req-757a58f4-579c-4e83-abae-88614cc65545 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] No waiting events found dispatching network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:39:59 user nova-compute[72998]: WARNING nova.compute.manager [req-31102622-1b45-4749-830a-a8e5195f1b0b req-757a58f4-579c-4e83-abae-88614cc65545 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received unexpected event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f for instance with vm_state active and task_state None.
Aug 17 08:39:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-3bb9cf5f-f19e-4d2f-ae3e-9ef0bc66952a tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.954s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-6198a5e7-d09d-4457-8d87-5f41bb1ba574 req-0f2ef857-39c8-4425-88b0-1783fba54ae7 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received event network-changed-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:40:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-6198a5e7-d09d-4457-8d87-5f41bb1ba574 req-0f2ef857-39c8-4425-88b0-1783fba54ae7 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Refreshing instance network info cache due to event network-changed-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:40:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6198a5e7-d09d-4457-8d87-5f41bb1ba574 req-0f2ef857-39c8-4425-88b0-1783fba54ae7 service nova] Acquiring lock "refresh_cache-cab97f26-4bc8-4d68-88b9-c3fc6932d88a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:40:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6198a5e7-d09d-4457-8d87-5f41bb1ba574 req-0f2ef857-39c8-4425-88b0-1783fba54ae7 service nova] Acquired lock "refresh_cache-cab97f26-4bc8-4d68-88b9-c3fc6932d88a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:40:10 user nova-compute[72998]: DEBUG nova.network.neutron [req-6198a5e7-d09d-4457-8d87-5f41bb1ba574 req-0f2ef857-39c8-4425-88b0-1783fba54ae7 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Refreshing network info cache for port 03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG nova.network.neutron [req-6198a5e7-d09d-4457-8d87-5f41bb1ba574 req-0f2ef857-39c8-4425-88b0-1783fba54ae7 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Updated VIF entry in instance network info cache for port 03247e13-2cbf-4cb9-a54f-8f06c4a9abf3. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG nova.network.neutron [req-6198a5e7-d09d-4457-8d87-5f41bb1ba574 req-0f2ef857-39c8-4425-88b0-1783fba54ae7 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Updating instance_info_cache with network_info: [{"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6198a5e7-d09d-4457-8d87-5f41bb1ba574 req-0f2ef857-39c8-4425-88b0-1783fba54ae7 service nova] Releasing lock "refresh_cache-cab97f26-4bc8-4d68-88b9-c3fc6932d88a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:40:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:40:12 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updating instance_info_cache with network_info: [{"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:40:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-d87b6f0b-95ce-41b2-b279-cab1f2d1175c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:40:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG nova.objects.instance [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lazy-loading 'flavor' on Instance uuid cab97f26-4bc8-4d68-88b9-c3fc6932d88a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:15 user nova-compute[72998]: INFO nova.compute.manager [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Attaching volume 78118e6d-1ddc-41cb-9954-c3232590de91 to /dev/vdb
Aug 17 08:40:15 user nova-compute[72998]: DEBUG os_brick.utils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[37950c76-2f91-492e-853f-8e2c5979be1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a079c61c-a9b8-4ff5-9b54-9e1c5fb94bd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a17fb2-6e2b-45c9-8253-c8f60131ed2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a881d6cd-d399-4a01-a86d-edc0ab222a64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:40:15 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:40:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[26513a20-4efa-4c6b-806f-34cd46e394be]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG os_brick.utils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:40:15 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Updating existing volume attachment record: 843d60d1-deec-4935-987d-2b61b07cbd1a {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:40:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:17 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:40:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:20 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:40:20 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:40:20 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8070MB free_disk=23.807125091552734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:40:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cab97f26-4bc8-4d68-88b9-c3fc6932d88a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 22883775-aeb8-473a-aae4-2120cb980709 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:40:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.697s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:22 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:23 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:24 user nova-compute[72998]: INFO nova.compute.manager [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Terminating instance
Aug 17 08:40:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-8a12ba3e-a4d2-4e86-8a01-b27876ee851a req-767e5b83-90d3-449d-9b56-44cb198d3880 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received event network-vif-unplugged-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8a12ba3e-a4d2-4e86-8a01-b27876ee851a req-767e5b83-90d3-449d-9b56-44cb198d3880 service nova] Acquiring lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8a12ba3e-a4d2-4e86-8a01-b27876ee851a req-767e5b83-90d3-449d-9b56-44cb198d3880 service nova] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8a12ba3e-a4d2-4e86-8a01-b27876ee851a req-767e5b83-90d3-449d-9b56-44cb198d3880 service nova] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-8a12ba3e-a4d2-4e86-8a01-b27876ee851a req-767e5b83-90d3-449d-9b56-44cb198d3880 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] No waiting events found dispatching network-vif-unplugged-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-8a12ba3e-a4d2-4e86-8a01-b27876ee851a req-767e5b83-90d3-449d-9b56-44cb198d3880 service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received event network-vif-unplugged-6e4b7487-b3b6-476f-96b6-97afb7265763 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Instance destroyed successfully.
Aug 17 08:40:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'resources' on Instance uuid ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-561767268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-561767268',id=30,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-vr4t4ei8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:32:57Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "6e4b7487-b3b6-476f-96b6-97afb7265763", "address": "fa:16:3e:3b:80:6d", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b7487-b3", "ovs_interfaceid": "6e4b7487-b3b6-476f-96b6-97afb7265763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=6e4b7487-b3b6-476f-96b6-97afb7265763,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4b7487-b3') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG os_vif [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=6e4b7487-b3b6-476f-96b6-97afb7265763,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4b7487-b3') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e4b7487-b3, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:25 user nova-compute[72998]: INFO os_vif [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:80:6d,bridge_name='br-int',has_traffic_filtering=True,id=6e4b7487-b3b6-476f-96b6-97afb7265763,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4b7487-b3')
Aug 17 08:40:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Deleting instance files /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4_del
Aug 17 08:40:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Deletion of /opt/stack/data/nova/instances/ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4_del complete
Aug 17 08:40:25 user nova-compute[72998]: INFO nova.compute.manager [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 08:40:25 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:40:25 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:40:26 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Took 0.70 seconds to deallocate network for instance.
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRqtnZLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:40:26 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:40:26 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:40:26 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1bab23-52ad-4856-9e43-ea8649ddf4e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:40:26 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[234e5e35-28df-48cd-b01a-67a196f85549]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91] added
Aug 17 08:40:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a26a71-0ea2-4709-8aae-151557e8fe76]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7244ac0a-6883-4a54-9ee0-4e57c0352a88]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRqtnZLA {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRqtnZLA" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df00709-9d6b-4e1f-a7a2-810d67fdd165]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GRqtnZLA'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fc59de-ee6e-40eb-8fdf-05da4745b579]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d384ec7-10c6-4b27-a20d-d38074f5463f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:40:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:40:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[68780f94-da36-4eb5-97a8-9e44db4b476e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91, portal: 172.16.0.220,3260]
Aug 17 08:40:26 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91, portal: 172.16.0.220,3260] successful.
Aug 17 08:40:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3203738-f890-4117-8069-cc70b28a6885]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68d2ef3-dbfd-441d-83fd-5bad86c0aacf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:40:26 user nova-compute[72998]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 (non-flash)
Aug 17 08:40:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:40:26 user nova-compute[72998]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 (non-flash)
Aug 17 08:40:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:40:26 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Deleted allocations for instance ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4
Aug 17 08:40:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae1da5f-098d-4daa-87b4-8be36ff1ca99]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRqtnZLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-edf76c2d-9266-4cf8-a0f5-e0ba01d457e2 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-0155d983-cdd9-4b29-9f17-5d148bb0fe09 req-e946a6bf-e252-43ce-88bc-65b677d3745e service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received event network-vif-plugged-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0155d983-cdd9-4b29-9f17-5d148bb0fe09 req-e946a6bf-e252-43ce-88bc-65b677d3745e service nova] Acquiring lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0155d983-cdd9-4b29-9f17-5d148bb0fe09 req-e946a6bf-e252-43ce-88bc-65b677d3745e service nova] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0155d983-cdd9-4b29-9f17-5d148bb0fe09 req-e946a6bf-e252-43ce-88bc-65b677d3745e service nova] Lock "ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-0155d983-cdd9-4b29-9f17-5d148bb0fe09 req-e946a6bf-e252-43ce-88bc-65b677d3745e service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] No waiting events found dispatching network-vif-plugged-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:40:26 user nova-compute[72998]: WARNING nova.compute.manager [req-0155d983-cdd9-4b29-9f17-5d148bb0fe09 req-e946a6bf-e252-43ce-88bc-65b677d3745e service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received unexpected event network-vif-plugged-6e4b7487-b3b6-476f-96b6-97afb7265763 for instance with vm_state deleted and task_state None.
Aug 17 08:40:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-0155d983-cdd9-4b29-9f17-5d148bb0fe09 req-e946a6bf-e252-43ce-88bc-65b677d3745e service nova] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Received event network-vif-deleted-6e4b7487-b3b6-476f-96b6-97afb7265763 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26366333964313534', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366333964313534', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG nova.objects.instance [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lazy-loading 'flavor' on Instance uuid cab97f26-4bc8-4d68-88b9-c3fc6932d88a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:40:27 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:40:27 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:40:27 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:40:27 user nova-compute[72998]:   <serial>78118e6d-1ddc-41cb-9954-c3232590de91</serial>
Aug 17 08:40:27 user nova-compute[72998]: </disk>
Aug 17 08:40:27 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:40:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] No VIF found with MAC fa:16:3e:f0:f4:c7, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:40:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-805e09ab-fabb-4beb-8e60-2bd39f7299f3 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.764s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:40:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:40:29 user nova-compute[72998]: INFO nova.compute.manager [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Detaching volume 78118e6d-1ddc-41cb-9954-c3232590de91
Aug 17 08:40:29 user nova-compute[72998]: INFO nova.virt.block_device [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Attempting to driver detach volume 78118e6d-1ddc-41cb-9954-c3232590de91 from mountpoint /dev/vdb
Aug 17 08:40:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Attempting to detach device vdb from instance cab97f26-4bc8-4d68-88b9-c3fc6932d88a from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:40:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:40:29 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:40:29 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:40:29 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:40:29 user nova-compute[72998]:   <serial>78118e6d-1ddc-41cb-9954-c3232590de91</serial>
Aug 17 08:40:29 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:40:29 user nova-compute[72998]: </disk>
Aug 17 08:40:29 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:40:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Successfully detached device vdb from instance cab97f26-4bc8-4d68-88b9-c3fc6932d88a from the persistent domain config.
Aug 17 08:40:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cab97f26-4bc8-4d68-88b9-c3fc6932d88a from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:40:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:40:29 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:40:29 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:40:29 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:40:29 user nova-compute[72998]:   <serial>78118e6d-1ddc-41cb-9954-c3232590de91</serial>
Aug 17 08:40:29 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:40:29 user nova-compute[72998]: </disk>
Aug 17 08:40:29 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692261630.4260745, cab97f26-4bc8-4d68-88b9-c3fc6932d88a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cab97f26-4bc8-4d68-88b9-c3fc6932d88a {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:40:30 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Successfully detached device vdb from instance cab97f26-4bc8-4d68-88b9-c3fc6932d88a from the live domain config.
Aug 17 08:40:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRqtnZLA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:40:30 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ab09f-1731-4695-bb9c-a2a8d492406b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0e66d1-766d-40c1-8539-bb2ebf0bf71b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:40:30 user nova-compute[72998]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 (non-flash)
Aug 17 08:40:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:40:30 user nova-compute[72998]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 (non-flash)
Aug 17 08:40:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464bff2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9769e8b-5373-4fd9-ab61-c4688e4f4471]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0681f08e-1efa-4e09-8cd2-6b240c642d1a]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e60a57-40a3-414d-8cc5-d529a52c78dd]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbf159d-54ca-4ff0-9fd0-6b60de0647c7]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaaf3b2-8749-49b9-ba10-9881d9e9e9e0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e2de6e-b0e6-41a9-b392-2c1276eeb1dc]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91, portal: 172.16.0.220,3260]
Aug 17 08:40:30 user nova-compute[72998]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91, portal: 172.16.0.220,3260] successful.
Aug 17 08:40:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78118e6d-1ddc-41cb-9954-c3232590de91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c833db-43c8-46d0-88f7-2d685137abe3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] <== disconnect_volume: return (260ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:40:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:40:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lazy-loading 'flavor' on Instance uuid cab97f26-4bc8-4d68-88b9-c3fc6932d88a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:40:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-906babe0-439a-4be0-986b-12683333b630 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:40:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 08:40:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 08:40:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:40:40 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261625.222359, ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:40:40 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] VM Stopped (Lifecycle Event)
Aug 17 08:40:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1832f71c-c813-47c0-8531-e47ae61e37ad None None] [instance: ef8e489f-9f0d-4e80-b777-f6dd1cfac3b4] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:40:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:40:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:40:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 3f5ecb29-58b4-4f01-bf32-633fffee8d59 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid cab97f26-4bc8-4d68-88b9-c3fc6932d88a {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 22883775-aeb8-473a-aae4-2120cb980709 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "22883775-aeb8-473a-aae4-2120cb980709" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "22883775-aeb8-473a-aae4-2120cb980709" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:41:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:41:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:41:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:41:12 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Updating instance_info_cache with network_info: [{"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:41:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-3f5ecb29-58b4-4f01-bf32-633fffee8d59" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:41:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:15 user nova-compute[72998]: INFO nova.compute.manager [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Terminating instance
Aug 17 08:41:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-e8afb8cf-24c1-4d95-95d4-1c68c30a99d2 req-a08b52dc-616b-4c98-9ee9-3ed5df96f4c8 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-unplugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e8afb8cf-24c1-4d95-95d4-1c68c30a99d2 req-a08b52dc-616b-4c98-9ee9-3ed5df96f4c8 service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e8afb8cf-24c1-4d95-95d4-1c68c30a99d2 req-a08b52dc-616b-4c98-9ee9-3ed5df96f4c8 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e8afb8cf-24c1-4d95-95d4-1c68c30a99d2 req-a08b52dc-616b-4c98-9ee9-3ed5df96f4c8 service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-e8afb8cf-24c1-4d95-95d4-1c68c30a99d2 req-a08b52dc-616b-4c98-9ee9-3ed5df96f4c8 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-unplugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-e8afb8cf-24c1-4d95-95d4-1c68c30a99d2 req-a08b52dc-616b-4c98-9ee9-3ed5df96f4c8 service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-unplugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:41:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Instance destroyed successfully.
Aug 17 08:41:15 user nova-compute[72998]: DEBUG nova.objects.instance [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'resources' on Instance uuid d87b6f0b-95ce-41b2-b279-cab1f2d1175c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-531330378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-531330378',id=24,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:27:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-ymmjmalx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:29:13Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=d87b6f0b-95ce-41b2-b279-cab1f2d1175c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "bff9c917-7426-41b6-af07-b62567ce81df", "address": "fa:16:3e:7c:6f:a1", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbff9c917-74", "ovs_interfaceid": "bff9c917-7426-41b6-af07-b62567ce81df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:6f:a1,bridge_name='br-int',has_traffic_filtering=True,id=bff9c917-7426-41b6-af07-b62567ce81df,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbff9c917-74') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_vif [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:6f:a1,bridge_name='br-int',has_traffic_filtering=True,id=bff9c917-7426-41b6-af07-b62567ce81df,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbff9c917-74') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbff9c917-74, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:41:15 user nova-compute[72998]: INFO os_vif [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:6f:a1,bridge_name='br-int',has_traffic_filtering=True,id=bff9c917-7426-41b6-af07-b62567ce81df,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbff9c917-74')
Aug 17 08:41:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnBVzviS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:41:15 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[32158732-dec0-4e35-b543-bf76ac0c3b46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1fab2-89fe-4fe3-ae99-bcd32b92bce7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:41:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 (non-flash)
Aug 17 08:41:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488576440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacaa54a-dcd3-4384-b1cb-9d2aa4a069fb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5b78ca-990b-4e5b-8280-e6caa2b10ff5]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:41:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a526e8d6-d0d6-4e93-b73f-d33fcba5db37]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[160b124d-5f83-4797-aca1-85ba8ecdc96e]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf327dc3-e18d-4a36-be90-c4235a761f55]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[06830dac-60af-448b-921b-03fd3421c30b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3, portal: 172.16.0.220,3260]
Aug 17 08:41:16 user nova-compute[72998]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3, portal: 172.16.0.220,3260] successful.
Aug 17 08:41:16 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e320fe64-93f4-4500-8e29-d108f2f221e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e55e97-5ed9-4abc-bf5e-a2e21464fdde]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] <== disconnect_volume: return (267ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:41:16 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Deleting instance files /opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c_del
Aug 17 08:41:16 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Deletion of /opt/stack/data/nova/instances/d87b6f0b-95ce-41b2-b279-cab1f2d1175c_del complete
Aug 17 08:41:16 user nova-compute[72998]: INFO nova.compute.manager [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 17 08:41:16 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:41:16 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:41:17 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:41:17 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Took 1.11 seconds to deallocate network for instance.
Aug 17 08:41:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-0758d521-bf97-426c-99fe-f6c67c5e60dd req-77c545b6-d704-4a84-9ae2-a27254fe31ab service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0758d521-bf97-426c-99fe-f6c67c5e60dd req-77c545b6-d704-4a84-9ae2-a27254fe31ab service nova] Acquiring lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0758d521-bf97-426c-99fe-f6c67c5e60dd req-77c545b6-d704-4a84-9ae2-a27254fe31ab service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0758d521-bf97-426c-99fe-f6c67c5e60dd req-77c545b6-d704-4a84-9ae2-a27254fe31ab service nova] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-0758d521-bf97-426c-99fe-f6c67c5e60dd req-77c545b6-d704-4a84-9ae2-a27254fe31ab service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] No waiting events found dispatching network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:41:17 user nova-compute[72998]: WARNING nova.compute.manager [req-0758d521-bf97-426c-99fe-f6c67c5e60dd req-77c545b6-d704-4a84-9ae2-a27254fe31ab service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received unexpected event network-vif-plugged-bff9c917-7426-41b6-af07-b62567ce81df for instance with vm_state active and task_state deleting.
Aug 17 08:41:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-0758d521-bf97-426c-99fe-f6c67c5e60dd req-77c545b6-d704-4a84-9ae2-a27254fe31ab service nova] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Received event network-vif-deleted-bff9c917-7426-41b6-af07-b62567ce81df {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:18 user nova-compute[72998]: INFO nova.compute.manager [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Took 0.81 seconds to detach 1 volumes for instance.
Aug 17 08:41:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:18 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:41:18 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:41:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:18 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Deleted allocations for instance d87b6f0b-95ce-41b2-b279-cab1f2d1175c
Aug 17 08:41:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-17c5e973-9ec8-4c0a-84ab-356533ed3599 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "d87b6f0b-95ce-41b2-b279-cab1f2d1175c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.498s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:41:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:22 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:41:22 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8273MB free_disk=23.929302215576172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance cab97f26-4bc8-4d68-88b9-c3fc6932d88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 22883775-aeb8-473a-aae4-2120cb980709 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:41:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-586b15b4-99e0-4f30-8557-10dba6932059 req-1d17bdd5-d964-442b-90b6-07307dde31ac service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received event network-changed-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-586b15b4-99e0-4f30-8557-10dba6932059 req-1d17bdd5-d964-442b-90b6-07307dde31ac service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Refreshing instance network info cache due to event network-changed-81a89519-bb86-4e57-b971-eb1b3237b1f7. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-586b15b4-99e0-4f30-8557-10dba6932059 req-1d17bdd5-d964-442b-90b6-07307dde31ac service nova] Acquiring lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-586b15b4-99e0-4f30-8557-10dba6932059 req-1d17bdd5-d964-442b-90b6-07307dde31ac service nova] Acquired lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG nova.network.neutron [req-586b15b4-99e0-4f30-8557-10dba6932059 req-1d17bdd5-d964-442b-90b6-07307dde31ac service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Refreshing network info cache for port 81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:27 user nova-compute[72998]: INFO nova.compute.manager [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Terminating instance
Aug 17 08:41:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG nova.network.neutron [req-586b15b4-99e0-4f30-8557-10dba6932059 req-1d17bdd5-d964-442b-90b6-07307dde31ac service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updated VIF entry in instance network info cache for port 81a89519-bb86-4e57-b971-eb1b3237b1f7. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG nova.network.neutron [req-586b15b4-99e0-4f30-8557-10dba6932059 req-1d17bdd5-d964-442b-90b6-07307dde31ac service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updating instance_info_cache with network_info: [{"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:41:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-586b15b4-99e0-4f30-8557-10dba6932059 req-1d17bdd5-d964-442b-90b6-07307dde31ac service nova] Releasing lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-febe6d16-b612-4fbd-b108-f028620b6183 req-bd3e4318-58cb-4e97-9be1-16fde70fe6c3 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received event network-vif-unplugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-febe6d16-b612-4fbd-b108-f028620b6183 req-bd3e4318-58cb-4e97-9be1-16fde70fe6c3 service nova] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-febe6d16-b612-4fbd-b108-f028620b6183 req-bd3e4318-58cb-4e97-9be1-16fde70fe6c3 service nova] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-febe6d16-b612-4fbd-b108-f028620b6183 req-bd3e4318-58cb-4e97-9be1-16fde70fe6c3 service nova] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-febe6d16-b612-4fbd-b108-f028620b6183 req-bd3e4318-58cb-4e97-9be1-16fde70fe6c3 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] No waiting events found dispatching network-vif-unplugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-febe6d16-b612-4fbd-b108-f028620b6183 req-bd3e4318-58cb-4e97-9be1-16fde70fe6c3 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received event network-vif-unplugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:41:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Instance destroyed successfully.
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lazy-loading 'resources' on Instance uuid cab97f26-4bc8-4d68-88b9-c3fc6932d88a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1309825375',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1309825375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1309825',id=37,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExFIemO1KKIe47qEPIBGGzWQbGniVasX2PbD8+McGV3iK1/QVVJwKLO9PBhsU3OtYr/jw8Wow8puUsYBlXbPKowbhzRVz/y4tScgiYOowUWDwJkrd6upEsSVSElsQAnoQ==',key_name='tempest-keypair-683687485',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffbb3156666b476f860039288c6b69c0',ramdisk_id='',reservation_id='r-fte5qlz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1045382181',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2bda65353ee4488b74eda92e0d383e7',uuid=cab97f26-4bc8-4d68-88b9-c3fc6932d88a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Converting VIF {"id": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "address": "fa:16:3e:f0:f4:c7", "network": {"id": "c1d53fc8-c48b-4bf7-81de-1645f1f18d37", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422104662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffbb3156666b476f860039288c6b69c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247e13-2c", "ovs_interfaceid": "03247e13-2cbf-4cb9-a54f-8f06c4a9abf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:f4:c7,bridge_name='br-int',has_traffic_filtering=True,id=03247e13-2cbf-4cb9-a54f-8f06c4a9abf3,network=Network(c1d53fc8-c48b-4bf7-81de-1645f1f18d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247e13-2c') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG os_vif [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:f4:c7,bridge_name='br-int',has_traffic_filtering=True,id=03247e13-2cbf-4cb9-a54f-8f06c4a9abf3,network=Network(c1d53fc8-c48b-4bf7-81de-1645f1f18d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247e13-2c') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03247e13-2c, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:41:28 user nova-compute[72998]: INFO os_vif [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:f4:c7,bridge_name='br-int',has_traffic_filtering=True,id=03247e13-2cbf-4cb9-a54f-8f06c4a9abf3,network=Network(c1d53fc8-c48b-4bf7-81de-1645f1f18d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247e13-2c')
Aug 17 08:41:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Deleting instance files /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a_del
Aug 17 08:41:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Deletion of /opt/stack/data/nova/instances/cab97f26-4bc8-4d68-88b9-c3fc6932d88a_del complete
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:28 user nova-compute[72998]: INFO nova.compute.manager [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 17 08:41:28 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:28 user nova-compute[72998]: INFO nova.compute.manager [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Terminating instance
Aug 17 08:41:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-447920ce-0c57-41e4-aac2-0b3269b3d3d0 req-fc883693-4fb9-456a-be51-a36d7027bd9d service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received event network-vif-unplugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-447920ce-0c57-41e4-aac2-0b3269b3d3d0 req-fc883693-4fb9-456a-be51-a36d7027bd9d service nova] Acquiring lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-447920ce-0c57-41e4-aac2-0b3269b3d3d0 req-fc883693-4fb9-456a-be51-a36d7027bd9d service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-447920ce-0c57-41e4-aac2-0b3269b3d3d0 req-fc883693-4fb9-456a-be51-a36d7027bd9d service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-447920ce-0c57-41e4-aac2-0b3269b3d3d0 req-fc883693-4fb9-456a-be51-a36d7027bd9d service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] No waiting events found dispatching network-vif-unplugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-447920ce-0c57-41e4-aac2-0b3269b3d3d0 req-fc883693-4fb9-456a-be51-a36d7027bd9d service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received event network-vif-unplugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:41:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Instance destroyed successfully.
Aug 17 08:41:29 user nova-compute[72998]: DEBUG nova.objects.instance [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lazy-loading 'resources' on Instance uuid 3f5ecb29-58b4-4f01-bf32-633fffee8d59 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-808450072',display_name='tempest-ServersNegativeTestJSON-server-808450072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-808450072',id=31,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80cd55d2a46440109d871d95b275ee35',ramdisk_id='',reservation_id='r-zapalxje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-767382591',owner_user_name='tempest-ServersNegativeTestJSON-767382591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:32:40Z,user_data=None,user_id='f38547b6181642c8b51ff26c5cece96a',uuid=3f5ecb29-58b4-4f01-bf32-633fffee8d59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converting VIF {"id": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "address": "fa:16:3e:5b:ae:05", "network": {"id": "88637421-23cc-4895-955a-ce02533371c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-854084500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80cd55d2a46440109d871d95b275ee35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5d6f0-f6", "ovs_interfaceid": "39b5d6f0-f61f-40cc-9b65-ca95b4c74847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:ae:05,bridge_name='br-int',has_traffic_filtering=True,id=39b5d6f0-f61f-40cc-9b65-ca95b4c74847,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5d6f0-f6') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG os_vif [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:ae:05,bridge_name='br-int',has_traffic_filtering=True,id=39b5d6f0-f61f-40cc-9b65-ca95b4c74847,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5d6f0-f6') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39b5d6f0-f6, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:41:29 user nova-compute[72998]: INFO os_vif [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:ae:05,bridge_name='br-int',has_traffic_filtering=True,id=39b5d6f0-f61f-40cc-9b65-ca95b4c74847,network=Network(88637421-23cc-4895-955a-ce02533371c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5d6f0-f6')
Aug 17 08:41:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Deleting instance files /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59_del
Aug 17 08:41:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Deletion of /opt/stack/data/nova/instances/3f5ecb29-58b4-4f01-bf32-633fffee8d59_del complete
Aug 17 08:41:29 user nova-compute[72998]: INFO nova.compute.manager [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 17 08:41:29 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:41:29 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-d8f6d994-3331-4e98-8544-d848e75e43a2 req-142e6463-6294-4387-afe5-ed3ef4e098d5 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received event network-vif-plugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d8f6d994-3331-4e98-8544-d848e75e43a2 req-142e6463-6294-4387-afe5-ed3ef4e098d5 service nova] Acquiring lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d8f6d994-3331-4e98-8544-d848e75e43a2 req-142e6463-6294-4387-afe5-ed3ef4e098d5 service nova] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d8f6d994-3331-4e98-8544-d848e75e43a2 req-142e6463-6294-4387-afe5-ed3ef4e098d5 service nova] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-d8f6d994-3331-4e98-8544-d848e75e43a2 req-142e6463-6294-4387-afe5-ed3ef4e098d5 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] No waiting events found dispatching network-vif-plugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:41:30 user nova-compute[72998]: WARNING nova.compute.manager [req-d8f6d994-3331-4e98-8544-d848e75e43a2 req-142e6463-6294-4387-afe5-ed3ef4e098d5 service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received unexpected event network-vif-plugged-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 for instance with vm_state active and task_state deleting.
Aug 17 08:41:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:41:30 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Took 0.64 seconds to deallocate network for instance.
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:30 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Took 1.77 seconds to deallocate network for instance.
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.092s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:30 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Deleted allocations for instance 3f5ecb29-58b4-4f01-bf32-633fffee8d59
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-be4f0f26-c143-4206-af1d-99ca7ba94753 tempest-ServersNegativeTestJSON-767382591 tempest-ServersNegativeTestJSON-767382591-project-member] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.115s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261675.8412237, d87b6f0b-95ce-41b2-b279-cab1f2d1175c => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:41:30 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] VM Stopped (Lifecycle Event)
Aug 17 08:41:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9f717445-874e-44d8-a49b-fabb43cd5df2 None None] [instance: d87b6f0b-95ce-41b2-b279-cab1f2d1175c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:30 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Deleted allocations for instance cab97f26-4bc8-4d68-88b9-c3fc6932d88a
Aug 17 08:41:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d01d6c2a-1432-47d0-b775-0adf0092d20d tempest-TestServerVolumeAttachScenarioOldVersion-1045382181 tempest-TestServerVolumeAttachScenarioOldVersion-1045382181-project-member] Lock "cab97f26-4bc8-4d68-88b9-c3fc6932d88a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.232s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received event network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] Acquiring lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] No waiting events found dispatching network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:41:31 user nova-compute[72998]: WARNING nova.compute.manager [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received unexpected event network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 for instance with vm_state deleted and task_state None.
Aug 17 08:41:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received event network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] Acquiring lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] Lock "3f5ecb29-58b4-4f01-bf32-633fffee8d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] No waiting events found dispatching network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:41:31 user nova-compute[72998]: WARNING nova.compute.manager [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received unexpected event network-vif-plugged-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 for instance with vm_state deleted and task_state None.
Aug 17 08:41:31 user nova-compute[72998]: DEBUG nova.compute.manager [req-e61d6686-0145-407c-ba06-1240f1ea51c1 req-c013c746-4bcc-4f16-94c8-f2c2bce69ede service nova] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Received event network-vif-deleted-03247e13-2cbf-4cb9-a54f-8f06c4a9abf3 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-889c1860-5ab7-4192-ab06-8b781e54ed67 req-01c6e4d4-8833-4a60-8e66-82b72f0ce853 service nova] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Received event network-vif-deleted-39b5d6f0-f61f-40cc-9b65-ca95b4c74847 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG nova.objects.instance [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'flavor' on Instance uuid 22883775-aeb8-473a-aae4-2120cb980709 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:32 user nova-compute[72998]: INFO nova.compute.manager [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Attaching volume eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 to /dev/vdb
Aug 17 08:41:32 user nova-compute[72998]: DEBUG os_brick.utils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f395cce3-e68b-4d37-8dcd-f6cce596fca8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b6475-4a54-4bff-842f-0a8551af8f70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[668d6bc8-411b-41b4-ac52-e0e9b1ed94eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a99d36-38c1-464f-ac2b-dfbb37faa2fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:41:32 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:41:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c25740-d79d-4bd5-b98e-42154c8296c5]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG os_brick.utils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:41:32 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updating existing volume attachment record: 504a3272-e813-43f4-81a1-219217ad775a {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:41:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYqGXWst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:41:42 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:41:42 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:41:42 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d23c84-5cc8-4a6f-942c-77f8bd879969]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:41:42 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0832753a-e93e-4c66-933a-617bf5c04824]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5] added
Aug 17 08:41:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aedc40-1ee2-43f4-bf6f-70778a5faea0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[41abd84a-bd93-4f34-9bf0-ed8ddc522939]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fYqGXWst {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fYqGXWst" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4bf3db-8192-4eab-97b0-19f28ac1bb0f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fYqGXWst'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aecb0e-c1e4-4720-90e7-32e7bcb13287]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eae3f9-ed5f-4d11-aec7-73656195ba3e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:41:42 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:41:42 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:41:42 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:41:42 user nova-compute[72998]: 
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4a498f-b23a-4de2-bf04-f28cacc0ec54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5, portal: 172.16.0.220,3260]
Aug 17 08:41:42 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5, portal: 172.16.0.220,3260] successful.
Aug 17 08:41:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e1ef1-37e2-4b7f-9280-9d7670e2f610]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd64ce0-8559-4780-854d-11f402e3745d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:41:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:41:42 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa4e38-dc74-4155-9e92-408287b39bd8]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:41:43 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261688.5324862, cab97f26-4bc8-4d68-88b9-c3fc6932d88a => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:41:43 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] VM Stopped (Lifecycle Event)
Aug 17 08:41:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-960bd1ca-45ee-4510-8e8b-4fb7db2c2546 None None] [instance: cab97f26-4bc8-4d68-88b9-c3fc6932d88a] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:41:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:41:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYqGXWst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:41:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:41:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23236343833376363', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:41:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236343833376363', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:41:43 user nova-compute[72998]: DEBUG nova.objects.instance [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'flavor' on Instance uuid 22883775-aeb8-473a-aae4-2120cb980709 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:41:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:41:43 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:41:43 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:41:43 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:41:43 user nova-compute[72998]:   <serial>eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5</serial>
Aug 17 08:41:43 user nova-compute[72998]: </disk>
Aug 17 08:41:43 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:41:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:41:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:41:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No VIF found with MAC fa:16:3e:8f:88:f4, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:41:44 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261689.493552, 3f5ecb29-58b4-4f01-bf32-633fffee8d59 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:41:44 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] VM Stopped (Lifecycle Event)
Aug 17 08:41:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b4d237b4-1ffc-4836-91b1-5539fa58af5f None None] [instance: 3f5ecb29-58b4-4f01-bf32-633fffee8d59] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:41:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-43f815da-4ccb-4117-bad0-0d8428c949ff tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.027s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "95627f56-e019-4f06-b40f-775734f93b14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:41:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:41:47 user nova-compute[72998]: INFO nova.compute.claims [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Claim successful on node user
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:41:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.objects.instance [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'flavor' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.policy [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad6fa0f0675942b18c911f61e39bf71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2b81f590b4c05bde54a7669412ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:41:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Creating image(s)
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "/opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "/opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "/opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:48 user nova-compute[72998]: INFO nova.compute.manager [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Attaching volume e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 to /dev/vdb
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG os_brick.utils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a402f1-715d-4d9f-938d-f1af3f0eff7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf19d1-19d1-44ba-b629-081d922a3bf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c39f6e6-179c-40d9-b1c7-cff0c3b909bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a0798c-5955-46e2-b940-3673f18dec5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:41:48 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9c41e4-d5d1-4c46-bbf7-df4bb25137bd]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG os_brick.utils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating existing volume attachment record: 89f53af1-8e2a-45f6-8254-4f5401373bfd {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.190s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk 1073741824" returned: 0 in 0.073s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:48 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Successfully created port: 31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.188s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Cannot resize image /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'migration_context' on Instance uuid 95627f56-e019-4f06-b40f-775734f93b14 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Ensure instance console log exists: /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Successfully updated port: 31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:41:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "refresh_cache-95627f56-e019-4f06-b40f-775734f93b14" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:41:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquired lock "refresh_cache-95627f56-e019-4f06-b40f-775734f93b14" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:41:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:41:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-dc427a25-805d-46de-b179-687e1023f18a req-6c46b140-c6be-41b2-8712-462b41d87df2 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-changed-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:50 user nova-compute[72998]: DEBUG nova.compute.manager [req-dc427a25-805d-46de-b179-687e1023f18a req-6c46b140-c6be-41b2-8712-462b41d87df2 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Refreshing instance network info cache due to event network-changed-31f5ca4d-586e-428f-9e36-76f69e61017a. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:41:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dc427a25-805d-46de-b179-687e1023f18a req-6c46b140-c6be-41b2-8712-462b41d87df2 service nova] Acquiring lock "refresh_cache-95627f56-e019-4f06-b40f-775734f93b14" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:41:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Updating instance_info_cache with network_info: [{"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Releasing lock "refresh_cache-95627f56-e019-4f06-b40f-775734f93b14" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Instance network_info: |[{"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dc427a25-805d-46de-b179-687e1023f18a req-6c46b140-c6be-41b2-8712-462b41d87df2 service nova] Acquired lock "refresh_cache-95627f56-e019-4f06-b40f-775734f93b14" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.network.neutron [req-dc427a25-805d-46de-b179-687e1023f18a req-6c46b140-c6be-41b2-8712-462b41d87df2 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Refreshing network info cache for port 31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Start _get_guest_xml network_info=[{"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:41:51 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:41:51 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:41:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1649178702',display_name='tempest-AttachVolumeNegativeTest-server-1649178702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1649178702',id=40,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0m7NHrWZm3yBoGQ9IgLrylSpMEALRmBCTsutlPwa7m5teLCFXQBI5hbgoNKp6mxtdvwCn1ghxomXj/Us80QF/HMt4VwfatvBEXfMJoihpnLdxAyWLlZitSL5lyurGm0g==',key_name='tempest-keypair-913453419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-37txg80y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=95627f56-e019-4f06-b40f-775734f93b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e8:73,bridge_name='br-int',has_traffic_filtering=True,id=31f5ca4d-586e-428f-9e36-76f69e61017a,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5ca4d-58') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'pci_devices' on Instance uuid 95627f56-e019-4f06-b40f-775734f93b14 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:41:51 user nova-compute[72998]:   <uuid>95627f56-e019-4f06-b40f-775734f93b14</uuid>
Aug 17 08:41:51 user nova-compute[72998]:   <name>instance-00000028</name>
Aug 17 08:41:51 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:41:51 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:41:51 user nova-compute[72998]:   <metadata>
Aug 17 08:41:51 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:41:51 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:41:51 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1649178702</nova:name>
Aug 17 08:41:51 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:41:51</nova:creationTime>
Aug 17 08:41:51 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:41:51 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:41:51 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:41:51 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:41:51 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:41:51 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:41:51 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:41:51 user nova-compute[72998]:       <nova:owner>
Aug 17 08:41:51 user nova-compute[72998]:         <nova:user uuid="ad6fa0f0675942b18c911f61e39bf71d">tempest-AttachVolumeNegativeTest-1248035146-project-member</nova:user>
Aug 17 08:41:51 user nova-compute[72998]:         <nova:project uuid="91f2b81f590b4c05bde54a7669412ac3">tempest-AttachVolumeNegativeTest-1248035146</nova:project>
Aug 17 08:41:51 user nova-compute[72998]:       </nova:owner>
Aug 17 08:41:51 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:41:51 user nova-compute[72998]:       <nova:ports>
Aug 17 08:41:51 user nova-compute[72998]:         <nova:port uuid="31f5ca4d-586e-428f-9e36-76f69e61017a">
Aug 17 08:41:51 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 08:41:51 user nova-compute[72998]:         </nova:port>
Aug 17 08:41:51 user nova-compute[72998]:       </nova:ports>
Aug 17 08:41:51 user nova-compute[72998]:     </nova:instance>
Aug 17 08:41:51 user nova-compute[72998]:   </metadata>
Aug 17 08:41:51 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:41:51 user nova-compute[72998]:     <system>
Aug 17 08:41:51 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:41:51 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:41:51 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:41:51 user nova-compute[72998]:       <entry name="serial">95627f56-e019-4f06-b40f-775734f93b14</entry>
Aug 17 08:41:51 user nova-compute[72998]:       <entry name="uuid">95627f56-e019-4f06-b40f-775734f93b14</entry>
Aug 17 08:41:51 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:41:51 user nova-compute[72998]:     </system>
Aug 17 08:41:51 user nova-compute[72998]:   </sysinfo>
Aug 17 08:41:51 user nova-compute[72998]:   <os>
Aug 17 08:41:51 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:41:51 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:41:51 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:41:51 user nova-compute[72998]:   </os>
Aug 17 08:41:51 user nova-compute[72998]:   <features>
Aug 17 08:41:51 user nova-compute[72998]:     <acpi/>
Aug 17 08:41:51 user nova-compute[72998]:     <apic/>
Aug 17 08:41:51 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:41:51 user nova-compute[72998]:   </features>
Aug 17 08:41:51 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:41:51 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:41:51 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:41:51 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:41:51 user nova-compute[72998]:   </clock>
Aug 17 08:41:51 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:41:51 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:41:51 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:41:51 user nova-compute[72998]:   </cpu>
Aug 17 08:41:51 user nova-compute[72998]:   <devices>
Aug 17 08:41:51 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:41:51 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:41:51 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk"/>
Aug 17 08:41:51 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:41:51 user nova-compute[72998]:     </disk>
Aug 17 08:41:51 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:41:51 user nova-compute[72998]:       <mac address="fa:16:3e:4b:e8:73"/>
Aug 17 08:41:51 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:41:51 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:41:51 user nova-compute[72998]:       <target dev="tap31f5ca4d-58"/>
Aug 17 08:41:51 user nova-compute[72998]:     </interface>
Aug 17 08:41:51 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:41:51 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/console.log" append="off"/>
Aug 17 08:41:51 user nova-compute[72998]:     </serial>
Aug 17 08:41:51 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:41:51 user nova-compute[72998]:     <video>
Aug 17 08:41:51 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:41:51 user nova-compute[72998]:     </video>
Aug 17 08:41:51 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:41:51 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:41:51 user nova-compute[72998]:     </rng>
Aug 17 08:41:51 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:41:51 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:41:51 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:41:51 user nova-compute[72998]:     </memballoon>
Aug 17 08:41:51 user nova-compute[72998]:   </devices>
Aug 17 08:41:51 user nova-compute[72998]: </domain>
Aug 17 08:41:51 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:41:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1649178702',display_name='tempest-AttachVolumeNegativeTest-server-1649178702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1649178702',id=40,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0m7NHrWZm3yBoGQ9IgLrylSpMEALRmBCTsutlPwa7m5teLCFXQBI5hbgoNKp6mxtdvwCn1ghxomXj/Us80QF/HMt4VwfatvBEXfMJoihpnLdxAyWLlZitSL5lyurGm0g==',key_name='tempest-keypair-913453419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-37txg80y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=95627f56-e019-4f06-b40f-775734f93b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e8:73,bridge_name='br-int',has_traffic_filtering=True,id=31f5ca4d-586e-428f-9e36-76f69e61017a,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5ca4d-58') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG os_vif [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e8:73,bridge_name='br-int',has_traffic_filtering=True,id=31f5ca4d-586e-428f-9e36-76f69e61017a,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5ca4d-58') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31f5ca4d-58, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31f5ca4d-58, col_values=(('external_ids', {'iface-id': '31f5ca4d-586e-428f-9e36-76f69e61017a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:e8:73', 'vm-uuid': '95627f56-e019-4f06-b40f-775734f93b14'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:51 user nova-compute[72998]: INFO os_vif [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e8:73,bridge_name='br-int',has_traffic_filtering=True,id=31f5ca4d-586e-428f-9e36-76f69e61017a,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5ca4d-58')
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No VIF found with MAC fa:16:3e:4b:e8:73, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.network.neutron [req-dc427a25-805d-46de-b179-687e1023f18a req-6c46b140-c6be-41b2-8712-462b41d87df2 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Updated VIF entry in instance network info cache for port 31f5ca4d-586e-428f-9e36-76f69e61017a. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG nova.network.neutron [req-dc427a25-805d-46de-b179-687e1023f18a req-6c46b140-c6be-41b2-8712-462b41d87df2 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Updating instance_info_cache with network_info: [{"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:41:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-dc427a25-805d-46de-b179-687e1023f18a req-6c46b140-c6be-41b2-8712-462b41d87df2 service nova] Releasing lock "refresh_cache-95627f56-e019-4f06-b40f-775734f93b14" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-32091d65-040b-4279-9f5d-941f91447dd8 req-5901a2bf-1965-4605-aa46-6446e4675bc8 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-32091d65-040b-4279-9f5d-941f91447dd8 req-5901a2bf-1965-4605-aa46-6446e4675bc8 service nova] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-32091d65-040b-4279-9f5d-941f91447dd8 req-5901a2bf-1965-4605-aa46-6446e4675bc8 service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-32091d65-040b-4279-9f5d-941f91447dd8 req-5901a2bf-1965-4605-aa46-6446e4675bc8 service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG nova.compute.manager [req-32091d65-040b-4279-9f5d-941f91447dd8 req-5901a2bf-1965-4605-aa46-6446e4675bc8 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] No waiting events found dispatching network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:41:52 user nova-compute[72998]: WARNING nova.compute.manager [req-32091d65-040b-4279-9f5d-941f91447dd8 req-5901a2bf-1965-4605-aa46-6446e4675bc8 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received unexpected event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a for instance with vm_state building and task_state spawning.
Aug 17 08:41:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261714.739891, 95627f56-e019-4f06-b40f-775734f93b14 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:41:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 95627f56-e019-4f06-b40f-775734f93b14] VM Resumed (Lifecycle Event)
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:41:54 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Instance spawned successfully.
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:41:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 95627f56-e019-4f06-b40f-775734f93b14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261714.7430284, 95627f56-e019-4f06-b40f-775734f93b14 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:41:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 95627f56-e019-4f06-b40f-775734f93b14] VM Started (Lifecycle Event)
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:41:54 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 95627f56-e019-4f06-b40f-775734f93b14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:41:54 user nova-compute[72998]: INFO nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 17 08:41:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:41:54 user nova-compute[72998]: INFO nova.compute.manager [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Took 6.99 seconds to build instance.
Aug 17 08:41:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d95fc5b8-84b5-4250-b643-1fa3d226a3ac tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "95627f56-e019-4f06-b40f-775734f93b14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.091s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-2cd37f88-41e4-47d0-90f6-9d0e15c89c07 req-b9092054-56d7-4ca7-b225-4133ac3e3b74 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:41:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2cd37f88-41e4-47d0-90f6-9d0e15c89c07 req-b9092054-56d7-4ca7-b225-4133ac3e3b74 service nova] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:41:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2cd37f88-41e4-47d0-90f6-9d0e15c89c07 req-b9092054-56d7-4ca7-b225-4133ac3e3b74 service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:41:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2cd37f88-41e4-47d0-90f6-9d0e15c89c07 req-b9092054-56d7-4ca7-b225-4133ac3e3b74 service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:41:55 user nova-compute[72998]: DEBUG nova.compute.manager [req-2cd37f88-41e4-47d0-90f6-9d0e15c89c07 req-b9092054-56d7-4ca7-b225-4133ac3e3b74 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] No waiting events found dispatching network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:41:55 user nova-compute[72998]: WARNING nova.compute.manager [req-2cd37f88-41e4-47d0-90f6-9d0e15c89c07 req-b9092054-56d7-4ca7-b225-4133ac3e3b74 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received unexpected event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a for instance with vm_state active and task_state None.
Aug 17 08:41:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjHSYzFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:41:59 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:41:59 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:41:59 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[58de1eca-585e-4ea8-8430-b37bda7699fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:41:59 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[92adec11-c297-411e-b1a4-a945fd55e621]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1] added
Aug 17 08:41:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa88cbc2-2693-4bba-a099-794dc166baed]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c665c7c-5f7a-4b52-aa94-b49f9d5adc16]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjHSYzFs {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjHSYzFs" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a748c-2a63-4d07-8f7b-dae15b26426b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LjHSYzFs'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c61dad-c916-432c-b232-27170a4c801b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[78204bb1-b2b9-41a3-ae31-aa71866be4f4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:41:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:41:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb77bf4f-7018-457f-9f86-6e610f36a5d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260]
Aug 17 08:41:59 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260] successful.
Aug 17 08:41:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9df6ff-17cf-4eba-81a5-2930b30e8734]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94cfc47-1d0a-4a5d-adb9-eafd65b5bff5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:41:59 user nova-compute[72998]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)
Aug 17 08:41:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:41:59 user nova-compute[72998]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)
Aug 17 08:41:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec12ddb1-83dc-458b-ada3-6d338c1abaf1]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:41:59 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:42:00 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:42:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjHSYzFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:42:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:42:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23061636161663038', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:42:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061636161663038', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:42:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'flavor' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:42:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:42:00 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:42:00 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:42:00 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:42:00 user nova-compute[72998]:   <serial>e47f47b5-7a2d-4665-ab27-46c4c9cd52a1</serial>
Aug 17 08:42:00 user nova-compute[72998]: </disk>
Aug 17 08:42:00 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:42:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:42:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:42:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No VIF found with MAC fa:16:3e:ee:61:9f, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:42:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-04775853-db92-433c-a217-da87fa7186b9 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.725s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:05 user nova-compute[72998]: INFO nova.compute.manager [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Terminating instance
Aug 17 08:42:05 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:42:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-d590e342-b2f8-49c6-96a9-c55f9eeddcab req-488a7e8e-cf86-4731-b790-9bf542eb11bb service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received event network-vif-unplugged-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d590e342-b2f8-49c6-96a9-c55f9eeddcab req-488a7e8e-cf86-4731-b790-9bf542eb11bb service nova] Acquiring lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d590e342-b2f8-49c6-96a9-c55f9eeddcab req-488a7e8e-cf86-4731-b790-9bf542eb11bb service nova] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d590e342-b2f8-49c6-96a9-c55f9eeddcab req-488a7e8e-cf86-4731-b790-9bf542eb11bb service nova] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-d590e342-b2f8-49c6-96a9-c55f9eeddcab req-488a7e8e-cf86-4731-b790-9bf542eb11bb service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] No waiting events found dispatching network-vif-unplugged-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-d590e342-b2f8-49c6-96a9-c55f9eeddcab req-488a7e8e-cf86-4731-b790-9bf542eb11bb service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received event network-vif-unplugged-f0936629-dd1e-4218-98cb-78c2d8267a97 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:42:06 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Instance destroyed successfully.
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lazy-loading 'resources' on Instance uuid c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:22:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1622936382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1622936382',id=19,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:22:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0a0f5a7b6484483231263041317df',ramdisk_id='',reservation_id='r-aa0ds4s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:24:24Z,user_data=None,user_id='cf94d9d63f9e4e5a9d0a4f175fddff16',uuid=c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converting VIF {"id": "f0936629-dd1e-4218-98cb-78c2d8267a97", "address": "fa:16:3e:8b:22:76", "network": {"id": "022a3734-1ca0-4745-8083-7e302a717948", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1386415536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0a0f5a7b6484483231263041317df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0936629-dd", "ovs_interfaceid": "f0936629-dd1e-4218-98cb-78c2d8267a97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:22:76,bridge_name='br-int',has_traffic_filtering=True,id=f0936629-dd1e-4218-98cb-78c2d8267a97,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0936629-dd') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG os_vif [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:22:76,bridge_name='br-int',has_traffic_filtering=True,id=f0936629-dd1e-4218-98cb-78c2d8267a97,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0936629-dd') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0936629-dd, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:42:06 user nova-compute[72998]: INFO os_vif [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:22:76,bridge_name='br-int',has_traffic_filtering=True,id=f0936629-dd1e-4218-98cb-78c2d8267a97,network=Network(022a3734-1ca0-4745-8083-7e302a717948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0936629-dd')
Aug 17 08:42:06 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Deleting instance files /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa_del
Aug 17 08:42:06 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Deletion of /opt/stack/data/nova/instances/c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa_del complete
Aug 17 08:42:06 user nova-compute[72998]: INFO nova.compute.manager [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 17 08:42:06 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:42:06 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:42:06 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Took 0.47 seconds to deallocate network for instance.
Aug 17 08:42:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:07 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:42:07 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:42:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:07 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Deleted allocations for instance c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa
Aug 17 08:42:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b1977df5-ad3a-4b4f-a19a-ace274486427 tempest-ServerBootFromVolumeStableRescueTest-1298365870 tempest-ServerBootFromVolumeStableRescueTest-1298365870-project-member] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.596s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-f497f8b7-339c-4f42-ba63-1e5d03db7932 req-12b20d92-5a37-449b-a2dd-5fff0e04f74c service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received event network-vif-plugged-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:42:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f497f8b7-339c-4f42-ba63-1e5d03db7932 req-12b20d92-5a37-449b-a2dd-5fff0e04f74c service nova] Acquiring lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f497f8b7-339c-4f42-ba63-1e5d03db7932 req-12b20d92-5a37-449b-a2dd-5fff0e04f74c service nova] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f497f8b7-339c-4f42-ba63-1e5d03db7932 req-12b20d92-5a37-449b-a2dd-5fff0e04f74c service nova] Lock "c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-f497f8b7-339c-4f42-ba63-1e5d03db7932 req-12b20d92-5a37-449b-a2dd-5fff0e04f74c service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] No waiting events found dispatching network-vif-plugged-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:42:08 user nova-compute[72998]: WARNING nova.compute.manager [req-f497f8b7-339c-4f42-ba63-1e5d03db7932 req-12b20d92-5a37-449b-a2dd-5fff0e04f74c service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received unexpected event network-vif-plugged-f0936629-dd1e-4218-98cb-78c2d8267a97 for instance with vm_state deleted and task_state None.
Aug 17 08:42:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-f497f8b7-339c-4f42-ba63-1e5d03db7932 req-12b20d92-5a37-449b-a2dd-5fff0e04f74c service nova] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Received event network-vif-deleted-f0936629-dd1e-4218-98cb-78c2d8267a97 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:42:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-552b01b3-d0cb-45b4-918c-400d174d2a25 req-57f9947f-374d-4892-a345-dde448691387 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-changed-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:42:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-552b01b3-d0cb-45b4-918c-400d174d2a25 req-57f9947f-374d-4892-a345-dde448691387 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing instance network info cache due to event network-changed-51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:42:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-552b01b3-d0cb-45b4-918c-400d174d2a25 req-57f9947f-374d-4892-a345-dde448691387 service nova] Acquiring lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:42:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-552b01b3-d0cb-45b4-918c-400d174d2a25 req-57f9947f-374d-4892-a345-dde448691387 service nova] Acquired lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:42:12 user nova-compute[72998]: DEBUG nova.network.neutron [req-552b01b3-d0cb-45b4-918c-400d174d2a25 req-57f9947f-374d-4892-a345-dde448691387 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:42:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:12 user nova-compute[72998]: DEBUG nova.network.neutron [req-552b01b3-d0cb-45b4-918c-400d174d2a25 req-57f9947f-374d-4892-a345-dde448691387 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updated VIF entry in instance network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:42:12 user nova-compute[72998]: DEBUG nova.network.neutron [req-552b01b3-d0cb-45b4-918c-400d174d2a25 req-57f9947f-374d-4892-a345-dde448691387 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:42:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-552b01b3-d0cb-45b4-918c-400d174d2a25 req-57f9947f-374d-4892-a345-dde448691387 service nova] Releasing lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:42:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:42:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:42:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-9ac7e613-9e78-43f2-819b-dd433a6a9563 req-16ac3c7c-23bd-4981-9a27-2cfaf7cd66f2 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-changed-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:42:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-9ac7e613-9e78-43f2-819b-dd433a6a9563 req-16ac3c7c-23bd-4981-9a27-2cfaf7cd66f2 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing instance network info cache due to event network-changed-51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:42:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9ac7e613-9e78-43f2-819b-dd433a6a9563 req-16ac3c7c-23bd-4981-9a27-2cfaf7cd66f2 service nova] Acquiring lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:42:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9ac7e613-9e78-43f2-819b-dd433a6a9563 req-16ac3c7c-23bd-4981-9a27-2cfaf7cd66f2 service nova] Acquired lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:42:14 user nova-compute[72998]: DEBUG nova.network.neutron [req-9ac7e613-9e78-43f2-819b-dd433a6a9563 req-16ac3c7c-23bd-4981-9a27-2cfaf7cd66f2 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:42:14 user nova-compute[72998]: DEBUG nova.network.neutron [req-9ac7e613-9e78-43f2-819b-dd433a6a9563 req-16ac3c7c-23bd-4981-9a27-2cfaf7cd66f2 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updated VIF entry in instance network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:42:14 user nova-compute[72998]: DEBUG nova.network.neutron [req-9ac7e613-9e78-43f2-819b-dd433a6a9563 req-16ac3c7c-23bd-4981-9a27-2cfaf7cd66f2 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:42:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9ac7e613-9e78-43f2-819b-dd433a6a9563 req-16ac3c7c-23bd-4981-9a27-2cfaf7cd66f2 service nova] Releasing lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:42:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:19 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:42:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:21 user nova-compute[72998]: INFO nova.compute.manager [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Rebooting instance
Aug 17 08:42:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261726.389225, c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:42:21 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] VM Stopped (Lifecycle Event)
Aug 17 08:42:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquired lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:42:21 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:42:21 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8415MB free_disk=24.07120132446289GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ee261c45-3e63-4d7d-9e4c-53daae1bc07e None None] [instance: c7e0bfc5-83ad-4dd8-b070-d4454c3ecbaa] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 22883775-aeb8-473a-aae4-2120cb980709 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 95627f56-e019-4f06-b40f-775734f93b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:42:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:22 user nova-compute[72998]: DEBUG nova.network.neutron [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:42:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Releasing lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:42:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:42:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:22 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Instance destroyed successfully.
Aug 17 08:42:22 user nova-compute[72998]: DEBUG nova.objects.instance [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'resources' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-338776735',display_name='tempest-TestMinimumBasicScenario-server-338776735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-338776735',id=39,image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvq2WNCTBYqBGuVWNmRO44oTXAGMUF6L7WNC8G5hcHlzClI4sQ6k9sVH9+bSyVWT3TIxX8+TweUWKfWKnn07FwLThKeZM7Uot2bjKbLCBVQFoWMZ6XV31ArdBk1Ga5Mg==',key_name='tempest-TestMinimumBasicScenario-735319624',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:39:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd77c6b0783945e8b87fa60b07e5232b',ramdisk_id='',reservation_id='r-5rc8avyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2058599716',owner_user_name='tempest-TestMinimumBasicScenario-2058599716-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:42:22Z,user_data=None,user_id='d05f5c4078974746b66bfa8506bdd7da',uuid=a1a4ce23-27ae-4109-864e-20dd0fb20a28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converting VIF {"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_vif [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ac5edc-30, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:42:23 user nova-compute[72998]: INFO os_vif [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30')
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjHSYzFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:42:23 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ca564e-b78f-4dbc-984f-efd7dc48ec74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd334df-2d2d-4372-bf62-5df27767b996]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464dbe200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-804834b0-87a9-4026-8a85-0922b7f11f36 req-3892d997-8815-4976-b95e-69a3aa458f65 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-unplugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-804834b0-87a9-4026-8a85-0922b7f11f36 req-3892d997-8815-4976-b95e-69a3aa458f65 service nova] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-804834b0-87a9-4026-8a85-0922b7f11f36 req-3892d997-8815-4976-b95e-69a3aa458f65 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-804834b0-87a9-4026-8a85-0922b7f11f36 req-3892d997-8815-4976-b95e-69a3aa458f65 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-804834b0-87a9-4026-8a85-0922b7f11f36 req-3892d997-8815-4976-b95e-69a3aa458f65 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] No waiting events found dispatching network-vif-unplugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:42:23 user nova-compute[72998]: WARNING nova.compute.manager [req-804834b0-87a9-4026-8a85-0922b7f11f36 req-3892d997-8815-4976-b95e-69a3aa458f65 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received unexpected event network-vif-unplugged-51ac5edc-30ee-4886-a432-6be31423371f for instance with vm_state active and task_state reboot_started_hard.
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f239f65-14ce-4e25-8a9b-c48cc0129220]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc9233-9e5a-4b16-9c5d-af144898f670]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[473e3409-2aab-4fe3-86cc-4e3bc5cd0531]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc09a0f-ca57-4b5a-98ad-ee0ebdfd4537]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4f2dbd-7fc7-43d3-9e76-b6a007c161be]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[da402c15-3340-4b85-994a-1b3b4ac36a1a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260]
Aug 17 08:42:23 user nova-compute[72998]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260] successful.
Aug 17 08:42:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9008d36c-96ea-46ff-b2f1-820e4020b88a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] <== disconnect_volume: return (324ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Start _get_guest_xml network_info=[{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=66c3b1d6-0c2a-4db7-8805-923c58b2adde,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '66c3b1d6-0c2a-4db7-8805-923c58b2adde'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '89f53af1-8e2a-45f6-8254-4f5401373bfd', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjHSYzFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a1a4ce23-27ae-4109-864e-20dd0fb20a28', 'attached_at': '', 'detached_at': '', 'volume_id': 'e47f47b5-7a2d-4665-ab27-46c4c9cd52a1', 'serial': 'e47f47b5-7a2d-4665-ab27-46c4c9cd52a1'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:42:23 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:42:23 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=66c3b1d6-0c2a-4db7-8805-923c58b2adde,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.objects.instance [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'vcpu_model' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjHSYzFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:42:23 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:42:23 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:42:23 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31be803-a232-4e46-a370-f56fc0e73b22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:42:23 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c1dbb1-f164-42b1-b053-83cd087674c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1] added
Aug 17 08:42:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b00d1a-b39d-49d1-b955-568d7a5d5f8c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[adade002-6cf0-4553-8894-a07bbae1a152]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjHSYzFs {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjHSYzFs" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[690a5fe1-3618-4fab-b601-c9f8c75e237e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LjHSYzFs'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a80672-d323-4e37-9db5-10d8929933c3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba978b6-1ad2-47bc-880d-581640c948aa]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d53b2e-03e2-4b88-b909-51fb400ff648]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260]
Aug 17 08:42:23 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260] successful.
Aug 17 08:42:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78d6a22-2a63-41a3-9ecf-0ff007d263ce]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[620f9748-c5a7-4b03-8f5a-6486bbafe88f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)
Aug 17 08:42:23 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[106bc24e-2f17-4713-a936-9af52442ab80]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:42:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjHSYzFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23061636161663038', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061636161663038', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-338776735',display_name='tempest-TestMinimumBasicScenario-server-338776735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-338776735',id=39,image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvq2WNCTBYqBGuVWNmRO44oTXAGMUF6L7WNC8G5hcHlzClI4sQ6k9sVH9+bSyVWT3TIxX8+TweUWKfWKnn07FwLThKeZM7Uot2bjKbLCBVQFoWMZ6XV31ArdBk1Ga5Mg==',key_name='tempest-TestMinimumBasicScenario-735319624',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:39:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd77c6b0783945e8b87fa60b07e5232b',ramdisk_id='',reservation_id='r-5rc8avyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2058599716',owner_user_name='tempest-TestMinimumBasicScenario-2058599716-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:42:22Z,user_data=None,user_id='d05f5c4078974746b66bfa8506bdd7da',uuid=a1a4ce23-27ae-4109-864e-20dd0fb20a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converting VIF {"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG nova.objects.instance [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'pci_devices' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:42:24 user nova-compute[72998]:   <uuid>a1a4ce23-27ae-4109-864e-20dd0fb20a28</uuid>
Aug 17 08:42:24 user nova-compute[72998]:   <name>instance-00000027</name>
Aug 17 08:42:24 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:42:24 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:42:24 user nova-compute[72998]:   <metadata>
Aug 17 08:42:24 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:42:24 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:42:24 user nova-compute[72998]:       <nova:name>tempest-TestMinimumBasicScenario-server-338776735</nova:name>
Aug 17 08:42:24 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:42:23</nova:creationTime>
Aug 17 08:42:24 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:42:24 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:42:24 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:42:24 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:42:24 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:42:24 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:42:24 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:42:24 user nova-compute[72998]:       <nova:owner>
Aug 17 08:42:24 user nova-compute[72998]:         <nova:user uuid="d05f5c4078974746b66bfa8506bdd7da">tempest-TestMinimumBasicScenario-2058599716-project-member</nova:user>
Aug 17 08:42:24 user nova-compute[72998]:         <nova:project uuid="cd77c6b0783945e8b87fa60b07e5232b">tempest-TestMinimumBasicScenario-2058599716</nova:project>
Aug 17 08:42:24 user nova-compute[72998]:       </nova:owner>
Aug 17 08:42:24 user nova-compute[72998]:       <nova:root type="image" uuid="66c3b1d6-0c2a-4db7-8805-923c58b2adde"/>
Aug 17 08:42:24 user nova-compute[72998]:       <nova:ports>
Aug 17 08:42:24 user nova-compute[72998]:         <nova:port uuid="51ac5edc-30ee-4886-a432-6be31423371f">
Aug 17 08:42:24 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 08:42:24 user nova-compute[72998]:         </nova:port>
Aug 17 08:42:24 user nova-compute[72998]:       </nova:ports>
Aug 17 08:42:24 user nova-compute[72998]:     </nova:instance>
Aug 17 08:42:24 user nova-compute[72998]:   </metadata>
Aug 17 08:42:24 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:42:24 user nova-compute[72998]:     <system>
Aug 17 08:42:24 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:42:24 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:42:24 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:42:24 user nova-compute[72998]:       <entry name="serial">a1a4ce23-27ae-4109-864e-20dd0fb20a28</entry>
Aug 17 08:42:24 user nova-compute[72998]:       <entry name="uuid">a1a4ce23-27ae-4109-864e-20dd0fb20a28</entry>
Aug 17 08:42:24 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:42:24 user nova-compute[72998]:     </system>
Aug 17 08:42:24 user nova-compute[72998]:   </sysinfo>
Aug 17 08:42:24 user nova-compute[72998]:   <os>
Aug 17 08:42:24 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:42:24 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:42:24 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:42:24 user nova-compute[72998]:   </os>
Aug 17 08:42:24 user nova-compute[72998]:   <features>
Aug 17 08:42:24 user nova-compute[72998]:     <acpi/>
Aug 17 08:42:24 user nova-compute[72998]:     <apic/>
Aug 17 08:42:24 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:42:24 user nova-compute[72998]:   </features>
Aug 17 08:42:24 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:42:24 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:42:24 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:42:24 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:42:24 user nova-compute[72998]:   </clock>
Aug 17 08:42:24 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:42:24 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:42:24 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:42:24 user nova-compute[72998]:   </cpu>
Aug 17 08:42:24 user nova-compute[72998]:   <devices>
Aug 17 08:42:24 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:42:24 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:42:24 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk"/>
Aug 17 08:42:24 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:42:24 user nova-compute[72998]:     </disk>
Aug 17 08:42:24 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:42:24 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:42:24 user nova-compute[72998]:       <source dev="/dev/sdc"/>
Aug 17 08:42:24 user nova-compute[72998]:       <target dev="vdb" bus="virtio"/>
Aug 17 08:42:24 user nova-compute[72998]:       <serial>e47f47b5-7a2d-4665-ab27-46c4c9cd52a1</serial>
Aug 17 08:42:24 user nova-compute[72998]:     </disk>
Aug 17 08:42:24 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:42:24 user nova-compute[72998]:       <mac address="fa:16:3e:ee:61:9f"/>
Aug 17 08:42:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:42:24 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:42:24 user nova-compute[72998]:       <target dev="tap51ac5edc-30"/>
Aug 17 08:42:24 user nova-compute[72998]:     </interface>
Aug 17 08:42:24 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:42:24 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/console.log" append="off"/>
Aug 17 08:42:24 user nova-compute[72998]:     </serial>
Aug 17 08:42:24 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:42:24 user nova-compute[72998]:     <video>
Aug 17 08:42:24 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:42:24 user nova-compute[72998]:     </video>
Aug 17 08:42:24 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:42:24 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:42:24 user nova-compute[72998]:     </rng>
Aug 17 08:42:24 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:42:24 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:42:24 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:42:24 user nova-compute[72998]:     </memballoon>
Aug 17 08:42:24 user nova-compute[72998]:   </devices>
Aug 17 08:42:24 user nova-compute[72998]: </domain>
Aug 17 08:42:24 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-6948237f-6364-4f17-bb03-e194147e031e req-7948f708-32b8-4776-a706-efc11abae415 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6948237f-6364-4f17-bb03-e194147e031e req-7948f708-32b8-4776-a706-efc11abae415 service nova] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6948237f-6364-4f17-bb03-e194147e031e req-7948f708-32b8-4776-a706-efc11abae415 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6948237f-6364-4f17-bb03-e194147e031e req-7948f708-32b8-4776-a706-efc11abae415 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-6948237f-6364-4f17-bb03-e194147e031e req-7948f708-32b8-4776-a706-efc11abae415 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] No waiting events found dispatching network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:42:25 user nova-compute[72998]: WARNING nova.compute.manager [req-6948237f-6364-4f17-bb03-e194147e031e req-7948f708-32b8-4776-a706-efc11abae415 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received unexpected event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f for instance with vm_state active and task_state reboot_started_hard.
Aug 17 08:42:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'trusted_certs' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Cannot resize image /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'migration_context' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-338776735',display_name='tempest-TestMinimumBasicScenario-server-338776735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-338776735',id=39,image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvq2WNCTBYqBGuVWNmRO44oTXAGMUF6L7WNC8G5hcHlzClI4sQ6k9sVH9+bSyVWT3TIxX8+TweUWKfWKnn07FwLThKeZM7Uot2bjKbLCBVQFoWMZ6XV31ArdBk1Ga5Mg==',key_name='tempest-TestMinimumBasicScenario-735319624',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:39:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='cd77c6b0783945e8b87fa60b07e5232b',ramdisk_id='',reservation_id='r-5rc8avyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2058599716',owner_user_name='tempest-TestMinimumBasicScenario-2058599716-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:42:22Z,user_data=None,user_id='d05f5c4078974746b66bfa8506bdd7da',uuid=a1a4ce23-27ae-4109-864e-20dd0fb20a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converting VIF {"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG os_vif [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51ac5edc-30, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51ac5edc-30, col_values=(('external_ids', {'iface-id': '51ac5edc-30ee-4886-a432-6be31423371f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:61:9f', 'vm-uuid': 'a1a4ce23-27ae-4109-864e-20dd0fb20a28'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:42:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:25 user nova-compute[72998]: INFO os_vif [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30')
Aug 17 08:42:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-6984f287-6d4a-48fe-92a6-bacc6d5fdb46 req-a0517e09-e87d-40e2-8576-ea8ce5c15ecb service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:42:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6984f287-6d4a-48fe-92a6-bacc6d5fdb46 req-a0517e09-e87d-40e2-8576-ea8ce5c15ecb service nova] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6984f287-6d4a-48fe-92a6-bacc6d5fdb46 req-a0517e09-e87d-40e2-8576-ea8ce5c15ecb service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6984f287-6d4a-48fe-92a6-bacc6d5fdb46 req-a0517e09-e87d-40e2-8576-ea8ce5c15ecb service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-6984f287-6d4a-48fe-92a6-bacc6d5fdb46 req-a0517e09-e87d-40e2-8576-ea8ce5c15ecb service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] No waiting events found dispatching network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:42:27 user nova-compute[72998]: WARNING nova.compute.manager [req-6984f287-6d4a-48fe-92a6-bacc6d5fdb46 req-a0517e09-e87d-40e2-8576-ea8ce5c15ecb service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received unexpected event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f for instance with vm_state active and task_state reboot_started_hard.
Aug 17 08:42:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for a1a4ce23-27ae-4109-864e-20dd0fb20a28 due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261749.171349, a1a4ce23-27ae-4109-864e-20dd0fb20a28 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:42:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] VM Resumed (Lifecycle Event)
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:42:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Instance rebooted successfully.
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:42:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261749.1723282, a1a4ce23-27ae-4109-864e-20dd0fb20a28 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:42:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] VM Started (Lifecycle Event)
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:42:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-d9184572-0de5-4d53-a16c-d6eba0ce414f req-c2b90add-cd35-41cd-bbf1-4bbcecb01133 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d9184572-0de5-4d53-a16c-d6eba0ce414f req-c2b90add-cd35-41cd-bbf1-4bbcecb01133 service nova] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d9184572-0de5-4d53-a16c-d6eba0ce414f req-c2b90add-cd35-41cd-bbf1-4bbcecb01133 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d9184572-0de5-4d53-a16c-d6eba0ce414f req-c2b90add-cd35-41cd-bbf1-4bbcecb01133 service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-d9184572-0de5-4d53-a16c-d6eba0ce414f req-c2b90add-cd35-41cd-bbf1-4bbcecb01133 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] No waiting events found dispatching network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:42:29 user nova-compute[72998]: WARNING nova.compute.manager [req-d9184572-0de5-4d53-a16c-d6eba0ce414f req-c2b90add-cd35-41cd-bbf1-4bbcecb01133 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received unexpected event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f for instance with vm_state active and task_state None.
Aug 17 08:42:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-78d4f41f-7d4d-49ce-bec6-f3d685536d55 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.146s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:42:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:42:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:42:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:42:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:42:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:43:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:43:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:43:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:43:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:43:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:43:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:43:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:43:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:43:13 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:43:13 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 22883775-aeb8-473a-aae4-2120cb980709 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:43:14 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updating instance_info_cache with network_info: [{"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:43:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-22883775-aeb8-473a-aae4-2120cb980709" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:43:14 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:43:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:20 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:43:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:43:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:43:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:21 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:43:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:43:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:43:23 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:43:23 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=24.066486358642578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 22883775-aeb8-473a-aae4-2120cb980709 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 95627f56-e019-4f06-b40f-775734f93b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:43:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:43:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:43:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:43:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:43:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:43:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:43:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:43:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:43:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:43:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:43:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:43:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:43:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:43:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-1b3ea7e1-e779-4fdf-aaa6-966cf2ca0fd4 req-caba1286-d480-483e-a362-1db512882d06 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-changed-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:43:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-1b3ea7e1-e779-4fdf-aaa6-966cf2ca0fd4 req-caba1286-d480-483e-a362-1db512882d06 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Refreshing instance network info cache due to event network-changed-31f5ca4d-586e-428f-9e36-76f69e61017a. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:43:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1b3ea7e1-e779-4fdf-aaa6-966cf2ca0fd4 req-caba1286-d480-483e-a362-1db512882d06 service nova] Acquiring lock "refresh_cache-95627f56-e019-4f06-b40f-775734f93b14" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:43:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1b3ea7e1-e779-4fdf-aaa6-966cf2ca0fd4 req-caba1286-d480-483e-a362-1db512882d06 service nova] Acquired lock "refresh_cache-95627f56-e019-4f06-b40f-775734f93b14" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:43:38 user nova-compute[72998]: DEBUG nova.network.neutron [req-1b3ea7e1-e779-4fdf-aaa6-966cf2ca0fd4 req-caba1286-d480-483e-a362-1db512882d06 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Refreshing network info cache for port 31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "95627f56-e019-4f06-b40f-775734f93b14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:39 user nova-compute[72998]: INFO nova.compute.manager [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Terminating instance
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-5be46939-4b00-4158-a047-786e74010524 req-003a213a-954a-4d1d-8382-9b3aabd7b5fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-unplugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5be46939-4b00-4158-a047-786e74010524 req-003a213a-954a-4d1d-8382-9b3aabd7b5fd service nova] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5be46939-4b00-4158-a047-786e74010524 req-003a213a-954a-4d1d-8382-9b3aabd7b5fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5be46939-4b00-4158-a047-786e74010524 req-003a213a-954a-4d1d-8382-9b3aabd7b5fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-5be46939-4b00-4158-a047-786e74010524 req-003a213a-954a-4d1d-8382-9b3aabd7b5fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] No waiting events found dispatching network-vif-unplugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-5be46939-4b00-4158-a047-786e74010524 req-003a213a-954a-4d1d-8382-9b3aabd7b5fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-unplugged-31f5ca4d-586e-428f-9e36-76f69e61017a for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-1b3ea7e1-e779-4fdf-aaa6-966cf2ca0fd4 req-caba1286-d480-483e-a362-1db512882d06 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Updated VIF entry in instance network info cache for port 31f5ca4d-586e-428f-9e36-76f69e61017a. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-1b3ea7e1-e779-4fdf-aaa6-966cf2ca0fd4 req-caba1286-d480-483e-a362-1db512882d06 service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Updating instance_info_cache with network_info: [{"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Instance destroyed successfully.
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'resources' on Instance uuid 95627f56-e019-4f06-b40f-775734f93b14 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:41:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1649178702',display_name='tempest-AttachVolumeNegativeTest-server-1649178702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1649178702',id=40,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0m7NHrWZm3yBoGQ9IgLrylSpMEALRmBCTsutlPwa7m5teLCFXQBI5hbgoNKp6mxtdvwCn1ghxomXj/Us80QF/HMt4VwfatvBEXfMJoihpnLdxAyWLlZitSL5lyurGm0g==',key_name='tempest-keypair-913453419',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-37txg80y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=95627f56-e019-4f06-b40f-775734f93b14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "31f5ca4d-586e-428f-9e36-76f69e61017a", "address": "fa:16:3e:4b:e8:73", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5ca4d-58", "ovs_interfaceid": "31f5ca4d-586e-428f-9e36-76f69e61017a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e8:73,bridge_name='br-int',has_traffic_filtering=True,id=31f5ca4d-586e-428f-9e36-76f69e61017a,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5ca4d-58') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG os_vif [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e8:73,bridge_name='br-int',has_traffic_filtering=True,id=31f5ca4d-586e-428f-9e36-76f69e61017a,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5ca4d-58') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-1b3ea7e1-e779-4fdf-aaa6-966cf2ca0fd4 req-caba1286-d480-483e-a362-1db512882d06 service nova] Releasing lock "refresh_cache-95627f56-e019-4f06-b40f-775734f93b14" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31f5ca4d-58, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:39 user nova-compute[72998]: INFO os_vif [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:e8:73,bridge_name='br-int',has_traffic_filtering=True,id=31f5ca4d-586e-428f-9e36-76f69e61017a,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5ca4d-58')
Aug 17 08:43:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Deleting instance files /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14_del
Aug 17 08:43:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Deletion of /opt/stack/data/nova/instances/95627f56-e019-4f06-b40f-775734f93b14_del complete
Aug 17 08:43:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:40 user nova-compute[72998]: INFO nova.compute.manager [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 17 08:43:40 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:43:40 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:43:40 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 95627f56-e019-4f06-b40f-775734f93b14] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:43:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:40 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:43:40 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Took 0.91 seconds to deallocate network for instance.
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-74529ee5-c517-49ee-8e59-2d5499fb0c8c req-cb2cd146-bf55-40ea-8c97-59657ada633f service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-deleted-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:41 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Deleted allocations for instance 95627f56-e019-4f06-b40f-775734f93b14
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-721fd09a-1637-421e-af6c-a24c0953c9b8 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "95627f56-e019-4f06-b40f-775734f93b14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] No waiting events found dispatching network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:43:41 user nova-compute[72998]: WARNING nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received unexpected event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a for instance with vm_state deleted and task_state None.
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] No waiting events found dispatching network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:43:41 user nova-compute[72998]: WARNING nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received unexpected event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a for instance with vm_state deleted and task_state None.
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] No waiting events found dispatching network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:43:41 user nova-compute[72998]: WARNING nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received unexpected event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a for instance with vm_state deleted and task_state None.
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-unplugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] No waiting events found dispatching network-vif-unplugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:43:41 user nova-compute[72998]: WARNING nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received unexpected event network-vif-unplugged-31f5ca4d-586e-428f-9e36-76f69e61017a for instance with vm_state deleted and task_state None.
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Acquiring lock "95627f56-e019-4f06-b40f-775734f93b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] Lock "95627f56-e019-4f06-b40f-775734f93b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:43:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] No waiting events found dispatching network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:43:41 user nova-compute[72998]: WARNING nova.compute.manager [req-808752fb-b99f-49e8-a410-6fa725af3c48 req-a7b21bd2-c223-4e12-970b-aea050c335fd service nova] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Received unexpected event network-vif-plugged-31f5ca4d-586e-428f-9e36-76f69e61017a for instance with vm_state deleted and task_state None.
Aug 17 08:43:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:54 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261819.932544, 95627f56-e019-4f06-b40f-775734f93b14 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:43:54 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 95627f56-e019-4f06-b40f-775734f93b14] VM Stopped (Lifecycle Event)
Aug 17 08:43:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8b578025-e37b-4062-bdad-0222fa6b508c None None] [instance: 95627f56-e019-4f06-b40f-775734f93b14] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:43:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:43:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:43:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:43:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:43:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:43:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:43:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:44:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-5937e145-0406-4c35-bc05-363e120b84ec req-b67408a4-1dff-4c83-ae3b-fb8dfc35820b service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-changed-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:44:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-5937e145-0406-4c35-bc05-363e120b84ec req-b67408a4-1dff-4c83-ae3b-fb8dfc35820b service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing instance network info cache due to event network-changed-51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:44:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5937e145-0406-4c35-bc05-363e120b84ec req-b67408a4-1dff-4c83-ae3b-fb8dfc35820b service nova] Acquiring lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:44:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5937e145-0406-4c35-bc05-363e120b84ec req-b67408a4-1dff-4c83-ae3b-fb8dfc35820b service nova] Acquired lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:44:13 user nova-compute[72998]: DEBUG nova.network.neutron [req-5937e145-0406-4c35-bc05-363e120b84ec req-b67408a4-1dff-4c83-ae3b-fb8dfc35820b service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:44:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG nova.network.neutron [req-5937e145-0406-4c35-bc05-363e120b84ec req-b67408a4-1dff-4c83-ae3b-fb8dfc35820b service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updated VIF entry in instance network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG nova.network.neutron [req-5937e145-0406-4c35-bc05-363e120b84ec req-b67408a4-1dff-4c83-ae3b-fb8dfc35820b service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5937e145-0406-4c35-bc05-363e120b84ec req-b67408a4-1dff-4c83-ae3b-fb8dfc35820b service nova] Releasing lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:44:14 user nova-compute[72998]: INFO nova.compute.manager [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Detaching volume e47f47b5-7a2d-4665-ab27-46c4c9cd52a1
Aug 17 08:44:14 user nova-compute[72998]: INFO nova.virt.block_device [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Attempting to driver detach volume e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 from mountpoint /dev/vdb
Aug 17 08:44:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Attempting to detach device vdb from instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:44:14 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:44:14 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:44:14 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:44:14 user nova-compute[72998]:   <serial>e47f47b5-7a2d-4665-ab27-46c4c9cd52a1</serial>
Aug 17 08:44:14 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 08:44:14 user nova-compute[72998]: </disk>
Aug 17 08:44:14 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:44:14 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully detached device vdb from instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 from the persistent domain config.
Aug 17 08:44:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:44:14 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:44:14 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:44:14 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:44:14 user nova-compute[72998]:   <serial>e47f47b5-7a2d-4665-ab27-46c4c9cd52a1</serial>
Aug 17 08:44:14 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 08:44:14 user nova-compute[72998]: </disk>
Aug 17 08:44:14 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692261854.8909347, a1a4ce23-27ae-4109-864e-20dd0fb20a28 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:44:14 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully detached device vdb from instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 from the live domain config.
Aug 17 08:44:14 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjHSYzFs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:44:14 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:44:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[30187cf4-58b1-4c5c-b616-76526473bed4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7af166-00ec-475e-a9fb-ae2094b1dca3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:44:14 user nova-compute[72998]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)
Aug 17 08:44:14 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:44:14 user nova-compute[72998]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 (non-flash)
Aug 17 08:44:14 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464dbedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb7641f-fe59-424c-b0f5-0974c0580a67]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea897216-2fc3-4ae8-b6e8-62b869bac99c]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7714ff25-b42f-44c9-b037-1269494638e3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e052e1b-3532-461d-949a-6d0253d73f4f]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8478914-cf9b-4f41-8cb6-c90dc2ec976d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5e50c5-8bd3-4b89-a733-3581c2bd4974]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260]
Aug 17 08:44:15 user nova-compute[72998]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1, portal: 172.16.0.220,3260] successful.
Aug 17 08:44:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e47f47b5-7a2d-4665-ab27-46c4c9cd52a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b52be56-9ccd-4602-bbd4-0a050dddc7d3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] <== disconnect_volume: return (284ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-64e3df86-5fd5-4706-a2ea-5e20125b3ce7 req-043396d5-eb74-4427-8125-a9b652588cd0 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-changed-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-64e3df86-5fd5-4706-a2ea-5e20125b3ce7 req-043396d5-eb74-4427-8125-a9b652588cd0 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing instance network info cache due to event network-changed-51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-64e3df86-5fd5-4706-a2ea-5e20125b3ce7 req-043396d5-eb74-4427-8125-a9b652588cd0 service nova] Acquiring lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-64e3df86-5fd5-4706-a2ea-5e20125b3ce7 req-043396d5-eb74-4427-8125-a9b652588cd0 service nova] Acquired lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG nova.network.neutron [req-64e3df86-5fd5-4706-a2ea-5e20125b3ce7 req-043396d5-eb74-4427-8125-a9b652588cd0 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Refreshing network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG nova.network.neutron [req-64e3df86-5fd5-4706-a2ea-5e20125b3ce7 req-043396d5-eb74-4427-8125-a9b652588cd0 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updated VIF entry in instance network info cache for port 51ac5edc-30ee-4886-a432-6be31423371f. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG nova.network.neutron [req-64e3df86-5fd5-4706-a2ea-5e20125b3ce7 req-043396d5-eb74-4427-8125-a9b652588cd0 service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-64e3df86-5fd5-4706-a2ea-5e20125b3ce7 req-043396d5-eb74-4427-8125-a9b652588cd0 service nova] Releasing lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:44:15 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:44:16 user nova-compute[72998]: DEBUG nova.objects.instance [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'flavor' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:44:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-60ca4dc9-efd0-4ce9-ae4e-4ffc6b913f0f tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.795s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:44:16 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [{"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:44:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-a1a4ce23-27ae-4109-864e-20dd0fb20a28" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:44:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:44:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:23 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:44:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:44:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:44:23 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:44:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:44:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:25 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:44:25 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:44:25 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=24.074901580810547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 22883775-aeb8-473a-aae4-2120cb980709 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:44:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:44:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:44:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:44:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:44:30 user nova-compute[72998]: INFO nova.compute.manager [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Detaching volume eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5
Aug 17 08:44:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:30 user nova-compute[72998]: INFO nova.virt.block_device [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Attempting to driver detach volume eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 from mountpoint /dev/vdb
Aug 17 08:44:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Attempting to detach device vdb from instance 22883775-aeb8-473a-aae4-2120cb980709 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:44:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:44:30 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:44:30 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:44:30 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:44:30 user nova-compute[72998]:   <serial>eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5</serial>
Aug 17 08:44:30 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:44:30 user nova-compute[72998]: </disk>
Aug 17 08:44:30 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:44:30 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully detached device vdb from instance 22883775-aeb8-473a-aae4-2120cb980709 from the persistent domain config.
Aug 17 08:44:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22883775-aeb8-473a-aae4-2120cb980709 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:44:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:44:30 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:44:30 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:44:30 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:44:30 user nova-compute[72998]:   <serial>eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5</serial>
Aug 17 08:44:30 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:44:30 user nova-compute[72998]: </disk>
Aug 17 08:44:30 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692261871.4012804, 22883775-aeb8-473a-aae4-2120cb980709 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22883775-aeb8-473a-aae4-2120cb980709 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:44:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully detached device vdb from instance 22883775-aeb8-473a-aae4-2120cb980709 from the live domain config.
Aug 17 08:44:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYqGXWst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:44:31 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb8c1e9-8950-45e1-b182-c79bf38cf4de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f04efa8-9357-473e-9ca5-e60df8031e0b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:44:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 (non-flash)
Aug 17 08:44:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488575090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e53843-d0c8-475e-89be-204a8acf83bb]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb77147-6fcb-4a41-aede-09f6d38b1700]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8de1385-9a29-49ce-9c41-2a867f5ce995]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75b47b7-25d6-47cf-81d0-b6f340f36eac]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[333599d6-d0e5-4880-bb79-ab8451099bb4]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85f8645-3e18-4de8-b63a-f6dc37e7eece]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5, portal: 172.16.0.220,3260]
Aug 17 08:44:31 user nova-compute[72998]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5, portal: 172.16.0.220,3260] successful.
Aug 17 08:44:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee4b5de-a8d6-4b44-869d-7cf9c7ba7ef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[67138a20-bb60-4776-ae64-749d0774e0eb]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] <== disconnect_volume: return (293ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:44:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:32 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'flavor' on Instance uuid 22883775-aeb8-473a-aae4-2120cb980709 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:44:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a7859d26-56e5-4c14-8eea-442ad92b6b78 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.752s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:44:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:44:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:44:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:44:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:44:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:44:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:44:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:44:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:44:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:12 user nova-compute[72998]: INFO nova.compute.manager [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Terminating instance
Aug 17 08:45:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-ce00a08a-67a3-4d95-a71a-af125f24e56e req-3c0efa6d-cbf1-4776-9392-ead7f54c70dd service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-unplugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ce00a08a-67a3-4d95-a71a-af125f24e56e req-3c0efa6d-cbf1-4776-9392-ead7f54c70dd service nova] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ce00a08a-67a3-4d95-a71a-af125f24e56e req-3c0efa6d-cbf1-4776-9392-ead7f54c70dd service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ce00a08a-67a3-4d95-a71a-af125f24e56e req-3c0efa6d-cbf1-4776-9392-ead7f54c70dd service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-ce00a08a-67a3-4d95-a71a-af125f24e56e req-3c0efa6d-cbf1-4776-9392-ead7f54c70dd service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] No waiting events found dispatching network-vif-unplugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:45:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-ce00a08a-67a3-4d95-a71a-af125f24e56e req-3c0efa6d-cbf1-4776-9392-ead7f54c70dd service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-unplugged-51ac5edc-30ee-4886-a432-6be31423371f for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:13 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Instance destroyed successfully.
Aug 17 08:45:13 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'resources' on Instance uuid a1a4ce23-27ae-4109-864e-20dd0fb20a28 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-338776735',display_name='tempest-TestMinimumBasicScenario-server-338776735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-338776735',id=39,image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgvq2WNCTBYqBGuVWNmRO44oTXAGMUF6L7WNC8G5hcHlzClI4sQ6k9sVH9+bSyVWT3TIxX8+TweUWKfWKnn07FwLThKeZM7Uot2bjKbLCBVQFoWMZ6XV31ArdBk1Ga5Mg==',key_name='tempest-TestMinimumBasicScenario-735319624',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:39:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd77c6b0783945e8b87fa60b07e5232b',ramdisk_id='',reservation_id='r-5rc8avyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='66c3b1d6-0c2a-4db7-8805-923c58b2adde',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2058599716',owner_user_name='tempest-TestMinimumBasicScenario-2058599716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:42:29Z,user_data=None,user_id='d05f5c4078974746b66bfa8506bdd7da',uuid=a1a4ce23-27ae-4109-864e-20dd0fb20a28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converting VIF {"id": "51ac5edc-30ee-4886-a432-6be31423371f", "address": "fa:16:3e:ee:61:9f", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ac5edc-30", "ovs_interfaceid": "51ac5edc-30ee-4886-a432-6be31423371f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG os_vif [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ac5edc-30, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:45:13 user nova-compute[72998]: INFO os_vif [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:61:9f,bridge_name='br-int',has_traffic_filtering=True,id=51ac5edc-30ee-4886-a432-6be31423371f,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ac5edc-30')
Aug 17 08:45:13 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Deleting instance files /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28_del
Aug 17 08:45:13 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Deletion of /opt/stack/data/nova/instances/a1a4ce23-27ae-4109-864e-20dd0fb20a28_del complete
Aug 17 08:45:13 user nova-compute[72998]: INFO nova.compute.manager [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 17 08:45:13 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:45:13 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:45:14 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Took 0.56 seconds to deallocate network for instance.
Aug 17 08:45:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-efe65bed-cb4b-42f1-a9cf-446a98e2efc8 req-c9be69f6-bf05-438d-8a7d-23f37b72568f service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-deleted-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:45:14 user nova-compute[72998]: INFO nova.compute.manager [req-efe65bed-cb4b-42f1-a9cf-446a98e2efc8 req-c9be69f6-bf05-438d-8a7d-23f37b72568f service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Neutron deleted interface 51ac5edc-30ee-4886-a432-6be31423371f; detaching it from the instance and deleting it from the info cache
Aug 17 08:45:14 user nova-compute[72998]: DEBUG nova.network.neutron [req-efe65bed-cb4b-42f1-a9cf-446a98e2efc8 req-c9be69f6-bf05-438d-8a7d-23f37b72568f service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-efe65bed-cb4b-42f1-a9cf-446a98e2efc8 req-c9be69f6-bf05-438d-8a7d-23f37b72568f service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Detach interface failed, port_id=51ac5edc-30ee-4886-a432-6be31423371f, reason: Instance a1a4ce23-27ae-4109-864e-20dd0fb20a28 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:14 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Deleted allocations for instance a1a4ce23-27ae-4109-864e-20dd0fb20a28
Aug 17 08:45:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d6ea64b-0bd7-40b6-bc21-6fc004bf7ce0 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.906s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-fcc8eadc-fb20-489f-a87e-46bdce78dac9 req-808a4fbf-ab61-4822-a4ee-7e096c0bf72e service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fcc8eadc-fb20-489f-a87e-46bdce78dac9 req-808a4fbf-ab61-4822-a4ee-7e096c0bf72e service nova] Acquiring lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fcc8eadc-fb20-489f-a87e-46bdce78dac9 req-808a4fbf-ab61-4822-a4ee-7e096c0bf72e service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fcc8eadc-fb20-489f-a87e-46bdce78dac9 req-808a4fbf-ab61-4822-a4ee-7e096c0bf72e service nova] Lock "a1a4ce23-27ae-4109-864e-20dd0fb20a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:14 user nova-compute[72998]: DEBUG nova.compute.manager [req-fcc8eadc-fb20-489f-a87e-46bdce78dac9 req-808a4fbf-ab61-4822-a4ee-7e096c0bf72e service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] No waiting events found dispatching network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:45:14 user nova-compute[72998]: WARNING nova.compute.manager [req-fcc8eadc-fb20-489f-a87e-46bdce78dac9 req-808a4fbf-ab61-4822-a4ee-7e096c0bf72e service nova] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Received unexpected event network-vif-plugged-51ac5edc-30ee-4886-a432-6be31423371f for instance with vm_state deleted and task_state None.
Aug 17 08:45:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:45:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:45:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:21 user nova-compute[72998]: INFO nova.compute.manager [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Terminating instance
Aug 17 08:45:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-053d3ca6-0fee-459c-b7c6-5d4ee001ee7f req-20a40e72-9a31-4c26-ac97-9cf07dbeb0c4 service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received event network-vif-unplugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-053d3ca6-0fee-459c-b7c6-5d4ee001ee7f req-20a40e72-9a31-4c26-ac97-9cf07dbeb0c4 service nova] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-053d3ca6-0fee-459c-b7c6-5d4ee001ee7f req-20a40e72-9a31-4c26-ac97-9cf07dbeb0c4 service nova] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-053d3ca6-0fee-459c-b7c6-5d4ee001ee7f req-20a40e72-9a31-4c26-ac97-9cf07dbeb0c4 service nova] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-053d3ca6-0fee-459c-b7c6-5d4ee001ee7f req-20a40e72-9a31-4c26-ac97-9cf07dbeb0c4 service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] No waiting events found dispatching network-vif-unplugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-053d3ca6-0fee-459c-b7c6-5d4ee001ee7f req-20a40e72-9a31-4c26-ac97-9cf07dbeb0c4 service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received event network-vif-unplugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:45:21 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Instance destroyed successfully.
Aug 17 08:45:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'resources' on Instance uuid 22883775-aeb8-473a-aae4-2120cb980709 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1397220662',display_name='tempest-AttachVolumeNegativeTest-server-1397220662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1397220662',id=38,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIwqsz/fERzeovg68Q86Gs2cOjFPSdJ7WSYqxQFpOTkIWVhEugLAhbOTMVfRvmAbN9sTAuktU8oHKUKBuod1w7yu26TbL/UbIpG960woi2P+CtYHHjZudePOp5T2MQVQg==',key_name='tempest-keypair-1826111675',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:39:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-25fzoru2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=22883775-aeb8-473a-aae4-2120cb980709,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "address": "fa:16:3e:8f:88:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a89519-bb", "ovs_interfaceid": "81a89519-bb86-4e57-b971-eb1b3237b1f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:88:f4,bridge_name='br-int',has_traffic_filtering=True,id=81a89519-bb86-4e57-b971-eb1b3237b1f7,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a89519-bb') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG os_vif [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:88:f4,bridge_name='br-int',has_traffic_filtering=True,id=81a89519-bb86-4e57-b971-eb1b3237b1f7,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a89519-bb') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81a89519-bb, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:21 user nova-compute[72998]: INFO os_vif [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:88:f4,bridge_name='br-int',has_traffic_filtering=True,id=81a89519-bb86-4e57-b971-eb1b3237b1f7,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a89519-bb')
Aug 17 08:45:21 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Deleting instance files /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709_del
Aug 17 08:45:21 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Deletion of /opt/stack/data/nova/instances/22883775-aeb8-473a-aae4-2120cb980709_del complete
Aug 17 08:45:22 user nova-compute[72998]: INFO nova.compute.manager [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 08:45:22 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:45:22 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:45:22 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 22883775-aeb8-473a-aae4-2120cb980709] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:45:22 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:45:23 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Took 1.01 seconds to deallocate network for instance.
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-06caebbd-6f76-494b-9041-175ffa75b206 req-d7467153-2257-49ae-b920-2e71d9c5f31b service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received event network-vif-deleted-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:45:23 user nova-compute[72998]: INFO nova.compute.manager [req-06caebbd-6f76-494b-9041-175ffa75b206 req-d7467153-2257-49ae-b920-2e71d9c5f31b service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Neutron deleted interface 81a89519-bb86-4e57-b971-eb1b3237b1f7; detaching it from the instance and deleting it from the info cache
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.network.neutron [req-06caebbd-6f76-494b-9041-175ffa75b206 req-d7467153-2257-49ae-b920-2e71d9c5f31b service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-06caebbd-6f76-494b-9041-175ffa75b206 req-d7467153-2257-49ae-b920-2e71d9c5f31b service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Detach interface failed, port_id=81a89519-bb86-4e57-b971-eb1b3237b1f7, reason: Instance 22883775-aeb8-473a-aae4-2120cb980709 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:23 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Deleted allocations for instance 22883775-aeb8-473a-aae4-2120cb980709
Aug 17 08:45:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-39deff2a-110e-4e56-906d-da01fed6da65 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "22883775-aeb8-473a-aae4-2120cb980709" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.419s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-9c8874f2-4fa7-427a-af98-30ca0d8d9829 req-164b3ca2-9c11-46ad-8fc8-6b87b4ee8fda service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received event network-vif-plugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9c8874f2-4fa7-427a-af98-30ca0d8d9829 req-164b3ca2-9c11-46ad-8fc8-6b87b4ee8fda service nova] Acquiring lock "22883775-aeb8-473a-aae4-2120cb980709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9c8874f2-4fa7-427a-af98-30ca0d8d9829 req-164b3ca2-9c11-46ad-8fc8-6b87b4ee8fda service nova] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9c8874f2-4fa7-427a-af98-30ca0d8d9829 req-164b3ca2-9c11-46ad-8fc8-6b87b4ee8fda service nova] Lock "22883775-aeb8-473a-aae4-2120cb980709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:23 user nova-compute[72998]: DEBUG nova.compute.manager [req-9c8874f2-4fa7-427a-af98-30ca0d8d9829 req-164b3ca2-9c11-46ad-8fc8-6b87b4ee8fda service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] No waiting events found dispatching network-vif-plugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:45:23 user nova-compute[72998]: WARNING nova.compute.manager [req-9c8874f2-4fa7-427a-af98-30ca0d8d9829 req-164b3ca2-9c11-46ad-8fc8-6b87b4ee8fda service nova] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Received unexpected event network-vif-plugged-81a89519-bb86-4e57-b971-eb1b3237b1f7 for instance with vm_state deleted and task_state None.
Aug 17 08:45:25 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:25 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:45:26 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:45:26 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:45:26 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=24.121089935302734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:45:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:45:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:45:26 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:45:26 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:45:26 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:45:26 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:45:26 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:45:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:45:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:28 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261913.3553762, a1a4ce23-27ae-4109-864e-20dd0fb20a28 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:45:28 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] VM Stopped (Lifecycle Event)
Aug 17 08:45:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f4221000-cc91-43bb-8a35-516bd72ae366 None None] [instance: a1a4ce23-27ae-4109-864e-20dd0fb20a28] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:45:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 08:45:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:45:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:45:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:45:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:45:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:45:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 08:45:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 08:45:36 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692261921.9679496, 22883775-aeb8-473a-aae4-2120cb980709 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:45:36 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 22883775-aeb8-473a-aae4-2120cb980709] VM Stopped (Lifecycle Event)
Aug 17 08:45:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6f7eb621-6d3a-435b-9a3f-167cac31a304 None None] [instance: 22883775-aeb8-473a-aae4-2120cb980709] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:45:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:45:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:45:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:45:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:45:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:45:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:45:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:45:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:45:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:45:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:45:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:45:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:46:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:46:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:06 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:46:06 user nova-compute[72998]: INFO nova.compute.claims [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Claim successful on node user
Aug 17 08:46:06 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:46:06 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:46:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.175s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:46:07 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:46:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG nova.policy [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05f5c4078974746b66bfa8506bdd7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd77c6b0783945e8b87fa60b07e5232b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:46:07 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Creating image(s)
Aug 17 08:46:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "/opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "/opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "/opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "839b860bda49e965de223da4b96ee91b344727c2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "839b860bda49e965de223da4b96ee91b344727c2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2.part --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2.part --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG nova.virt.images [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] 0bda9120-3bb6-44f0-ad16-144c41c77c97 was qcow2, converting to raw {{(pid=72998) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG nova.privsep.utils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72998) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2.part /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2.converted {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:07 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Successfully created port: 5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2.part /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2.converted" returned: 0 in 0.253s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2.converted --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "839b860bda49e965de223da4b96ee91b344727c2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.078s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2 --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "839b860bda49e965de223da4b96ee91b344727c2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "839b860bda49e965de223da4b96ee91b344727c2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2 --force-share --output=json" returned: 0 in 0.173s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2,backing_fmt=raw /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2,backing_fmt=raw /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk 1073741824" returned: 0 in 0.050s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "839b860bda49e965de223da4b96ee91b344727c2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Successfully updated port: 5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-e490873d-3999-4368-9d87-bcc144ca2dea req-1753c0e3-95fb-470c-aaed-fb85832d6d65 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-e490873d-3999-4368-9d87-bcc144ca2dea req-1753c0e3-95fb-470c-aaed-fb85832d6d65 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing instance network info cache due to event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e490873d-3999-4368-9d87-bcc144ca2dea req-1753c0e3-95fb-470c-aaed-fb85832d6d65 service nova] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2 --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:08 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Cannot resize image /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'migration_context' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Ensure instance console log exists: /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Instance network_info: |[{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e490873d-3999-4368-9d87-bcc144ca2dea req-1753c0e3-95fb-470c-aaed-fb85832d6d65 service nova] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.network.neutron [req-e490873d-3999-4368-9d87-bcc144ca2dea req-1753c0e3-95fb-470c-aaed-fb85832d6d65 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Start _get_guest_xml network_info=[{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:46:04Z,direct_url=<?>,disk_format='qcow2',id=0bda9120-3bb6-44f0-ad16-144c41c77c97,min_disk=0,min_ram=0,name='tempest-scenario-img--2005615414',owner='cd77c6b0783945e8b87fa60b07e5232b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:46:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '0bda9120-3bb6-44f0-ad16-144c41c77c97'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:46:09 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:46:09 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:46:04Z,direct_url=<?>,disk_format='qcow2',id=0bda9120-3bb6-44f0-ad16-144c41c77c97,min_disk=0,min_ram=0,name='tempest-scenario-img--2005615414',owner='cd77c6b0783945e8b87fa60b07e5232b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:46:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-332738239',display_name='tempest-TestMinimumBasicScenario-server-332738239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-332738239',id=41,image_ref='0bda9120-3bb6-44f0-ad16-144c41c77c97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLK9JtQ9qe1sxx+AxTTdJ62l6XfznpBYwgoc76iN18lIhKWGpNSD/a161gSU1Oywgt6/Tqoq++Q7/UcsNMSVTPWbyyrNpDG0fdnZNebcgQrTJoRh4JF5X3Kbb2JfHm2MA==',key_name='tempest-TestMinimumBasicScenario-1256484932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd77c6b0783945e8b87fa60b07e5232b',ramdisk_id='',reservation_id='r-omf9p6ph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0bda9120-3bb6-44f0-ad16-144c41c77c97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2058599716',owner_user_name='tempest-TestMinimumBasicScenario-2058599716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:46:07Z,user_data=None,user_id='d05f5c4078974746b66bfa8506bdd7da',uuid=48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converting VIF {"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d4:ae,bridge_name='br-int',has_traffic_filtering=True,id=5862e0ac-f719-40ec-b253-388148b78aa5,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5862e0ac-f7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'pci_devices' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:46:09 user nova-compute[72998]:   <uuid>48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9</uuid>
Aug 17 08:46:09 user nova-compute[72998]:   <name>instance-00000029</name>
Aug 17 08:46:09 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:46:09 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:46:09 user nova-compute[72998]:   <metadata>
Aug 17 08:46:09 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:46:09 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:46:09 user nova-compute[72998]:       <nova:name>tempest-TestMinimumBasicScenario-server-332738239</nova:name>
Aug 17 08:46:09 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:46:09</nova:creationTime>
Aug 17 08:46:09 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:46:09 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:46:09 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:46:09 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:46:09 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:46:09 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:46:09 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:46:09 user nova-compute[72998]:       <nova:owner>
Aug 17 08:46:09 user nova-compute[72998]:         <nova:user uuid="d05f5c4078974746b66bfa8506bdd7da">tempest-TestMinimumBasicScenario-2058599716-project-member</nova:user>
Aug 17 08:46:09 user nova-compute[72998]:         <nova:project uuid="cd77c6b0783945e8b87fa60b07e5232b">tempest-TestMinimumBasicScenario-2058599716</nova:project>
Aug 17 08:46:09 user nova-compute[72998]:       </nova:owner>
Aug 17 08:46:09 user nova-compute[72998]:       <nova:root type="image" uuid="0bda9120-3bb6-44f0-ad16-144c41c77c97"/>
Aug 17 08:46:09 user nova-compute[72998]:       <nova:ports>
Aug 17 08:46:09 user nova-compute[72998]:         <nova:port uuid="5862e0ac-f719-40ec-b253-388148b78aa5">
Aug 17 08:46:09 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 08:46:09 user nova-compute[72998]:         </nova:port>
Aug 17 08:46:09 user nova-compute[72998]:       </nova:ports>
Aug 17 08:46:09 user nova-compute[72998]:     </nova:instance>
Aug 17 08:46:09 user nova-compute[72998]:   </metadata>
Aug 17 08:46:09 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:46:09 user nova-compute[72998]:     <system>
Aug 17 08:46:09 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:46:09 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:46:09 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:46:09 user nova-compute[72998]:       <entry name="serial">48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9</entry>
Aug 17 08:46:09 user nova-compute[72998]:       <entry name="uuid">48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9</entry>
Aug 17 08:46:09 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:46:09 user nova-compute[72998]:     </system>
Aug 17 08:46:09 user nova-compute[72998]:   </sysinfo>
Aug 17 08:46:09 user nova-compute[72998]:   <os>
Aug 17 08:46:09 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:46:09 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:46:09 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:46:09 user nova-compute[72998]:   </os>
Aug 17 08:46:09 user nova-compute[72998]:   <features>
Aug 17 08:46:09 user nova-compute[72998]:     <acpi/>
Aug 17 08:46:09 user nova-compute[72998]:     <apic/>
Aug 17 08:46:09 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:46:09 user nova-compute[72998]:   </features>
Aug 17 08:46:09 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:46:09 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:46:09 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:46:09 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:46:09 user nova-compute[72998]:   </clock>
Aug 17 08:46:09 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:46:09 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:46:09 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:46:09 user nova-compute[72998]:   </cpu>
Aug 17 08:46:09 user nova-compute[72998]:   <devices>
Aug 17 08:46:09 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:46:09 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:46:09 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk"/>
Aug 17 08:46:09 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:46:09 user nova-compute[72998]:     </disk>
Aug 17 08:46:09 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:46:09 user nova-compute[72998]:       <mac address="fa:16:3e:5b:d4:ae"/>
Aug 17 08:46:09 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:46:09 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:46:09 user nova-compute[72998]:       <target dev="tap5862e0ac-f7"/>
Aug 17 08:46:09 user nova-compute[72998]:     </interface>
Aug 17 08:46:09 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:46:09 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/console.log" append="off"/>
Aug 17 08:46:09 user nova-compute[72998]:     </serial>
Aug 17 08:46:09 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:46:09 user nova-compute[72998]:     <video>
Aug 17 08:46:09 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:46:09 user nova-compute[72998]:     </video>
Aug 17 08:46:09 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:46:09 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:46:09 user nova-compute[72998]:     </rng>
Aug 17 08:46:09 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:46:09 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:46:09 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:46:09 user nova-compute[72998]:     </memballoon>
Aug 17 08:46:09 user nova-compute[72998]:   </devices>
Aug 17 08:46:09 user nova-compute[72998]: </domain>
Aug 17 08:46:09 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-332738239',display_name='tempest-TestMinimumBasicScenario-server-332738239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-332738239',id=41,image_ref='0bda9120-3bb6-44f0-ad16-144c41c77c97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLK9JtQ9qe1sxx+AxTTdJ62l6XfznpBYwgoc76iN18lIhKWGpNSD/a161gSU1Oywgt6/Tqoq++Q7/UcsNMSVTPWbyyrNpDG0fdnZNebcgQrTJoRh4JF5X3Kbb2JfHm2MA==',key_name='tempest-TestMinimumBasicScenario-1256484932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd77c6b0783945e8b87fa60b07e5232b',ramdisk_id='',reservation_id='r-omf9p6ph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0bda9120-3bb6-44f0-ad16-144c41c77c97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2058599716',owner_user_name='tempest-TestMinimumBasicScenario-2058599716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:46:07Z,user_data=None,user_id='d05f5c4078974746b66bfa8506bdd7da',uuid=48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converting VIF {"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d4:ae,bridge_name='br-int',has_traffic_filtering=True,id=5862e0ac-f719-40ec-b253-388148b78aa5,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5862e0ac-f7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG os_vif [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d4:ae,bridge_name='br-int',has_traffic_filtering=True,id=5862e0ac-f719-40ec-b253-388148b78aa5,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5862e0ac-f7') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5862e0ac-f7, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5862e0ac-f7, col_values=(('external_ids', {'iface-id': '5862e0ac-f719-40ec-b253-388148b78aa5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:d4:ae', 'vm-uuid': '48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:09 user nova-compute[72998]: INFO os_vif [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d4:ae,bridge_name='br-int',has_traffic_filtering=True,id=5862e0ac-f719-40ec-b253-388148b78aa5,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5862e0ac-f7')
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No VIF found with MAC fa:16:3e:5b:d4:ae, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.network.neutron [req-e490873d-3999-4368-9d87-bcc144ca2dea req-1753c0e3-95fb-470c-aaed-fb85832d6d65 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updated VIF entry in instance network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG nova.network.neutron [req-e490873d-3999-4368-9d87-bcc144ca2dea req-1753c0e3-95fb-470c-aaed-fb85832d6d65 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:46:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e490873d-3999-4368-9d87-bcc144ca2dea req-1753c0e3-95fb-470c-aaed-fb85832d6d65 service nova] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:46:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-00080a03-fa51-4a47-818d-733990860b62 req-f3a2bec0-02e1-4735-8da1-e25f70c5183e service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:46:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-00080a03-fa51-4a47-818d-733990860b62 req-f3a2bec0-02e1-4735-8da1-e25f70c5183e service nova] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-00080a03-fa51-4a47-818d-733990860b62 req-f3a2bec0-02e1-4735-8da1-e25f70c5183e service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-00080a03-fa51-4a47-818d-733990860b62 req-f3a2bec0-02e1-4735-8da1-e25f70c5183e service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-00080a03-fa51-4a47-818d-733990860b62 req-f3a2bec0-02e1-4735-8da1-e25f70c5183e service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] No waiting events found dispatching network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:46:10 user nova-compute[72998]: WARNING nova.compute.manager [req-00080a03-fa51-4a47-818d-733990860b62 req-f3a2bec0-02e1-4735-8da1-e25f70c5183e service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received unexpected event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 for instance with vm_state building and task_state spawning.
Aug 17 08:46:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261972.8316174, 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:46:12 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] VM Resumed (Lifecycle Event)
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:46:12 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Instance spawned successfully.
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:46:12 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261972.833333, 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:46:12 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] VM Started (Lifecycle Event)
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:46:12 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:46:12 user nova-compute[72998]: INFO nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-46568a25-927e-45ea-a60b-0ac7bb85a5be req-bcd7f4f2-045f-41c6-872d-e344e43bd3fc service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-46568a25-927e-45ea-a60b-0ac7bb85a5be req-bcd7f4f2-045f-41c6-872d-e344e43bd3fc service nova] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-46568a25-927e-45ea-a60b-0ac7bb85a5be req-bcd7f4f2-045f-41c6-872d-e344e43bd3fc service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-46568a25-927e-45ea-a60b-0ac7bb85a5be req-bcd7f4f2-045f-41c6-872d-e344e43bd3fc service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-46568a25-927e-45ea-a60b-0ac7bb85a5be req-bcd7f4f2-045f-41c6-872d-e344e43bd3fc service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] No waiting events found dispatching network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:46:12 user nova-compute[72998]: WARNING nova.compute.manager [req-46568a25-927e-45ea-a60b-0ac7bb85a5be req-bcd7f4f2-045f-41c6-872d-e344e43bd3fc service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received unexpected event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 for instance with vm_state building and task_state spawning.
Aug 17 08:46:13 user nova-compute[72998]: INFO nova.compute.manager [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Took 6.27 seconds to build instance.
Aug 17 08:46:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6b7b5222-2e87-49be-851e-93da78787531 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.361s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:46:15 user nova-compute[72998]: INFO nova.compute.claims [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Claim successful on node user
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:46:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.policy [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad6fa0f0675942b18c911f61e39bf71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2b81f590b4c05bde54a7669412ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:46:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Creating image(s)
Aug 17 08:46:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "/opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "/opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "/opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.196s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.199s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk 1073741824" returned: 0 in 0.124s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Successfully created port: c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.248s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Skipping network cache update for instance because it is Building. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Cannot resize image /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'migration_context' on Instance uuid 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Ensure instance console log exists: /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:46:16 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Successfully updated port: c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquired lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-a877a85b-dcf8-4cfc-afed-7b661fa333c1 req-c011dba7-9baa-4877-9a38-4cde9840a5b8 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received event network-changed-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-a877a85b-dcf8-4cfc-afed-7b661fa333c1 req-c011dba7-9baa-4877-9a38-4cde9840a5b8 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Refreshing instance network info cache due to event network-changed-c1caa4a4-4e55-49ab-b581-4e6c9783f17e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a877a85b-dcf8-4cfc-afed-7b661fa333c1 req-c011dba7-9baa-4877-9a38-4cde9840a5b8 service nova] Acquiring lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:46:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Updating instance_info_cache with network_info: [{"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Releasing lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Instance network_info: |[{"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a877a85b-dcf8-4cfc-afed-7b661fa333c1 req-c011dba7-9baa-4877-9a38-4cde9840a5b8 service nova] Acquired lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-a877a85b-dcf8-4cfc-afed-7b661fa333c1 req-c011dba7-9baa-4877-9a38-4cde9840a5b8 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Refreshing network info cache for port c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Start _get_guest_xml network_info=[{"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:46:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:46:18 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911427318',display_name='tempest-AttachVolumeNegativeTest-server-1911427318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911427318',id=42,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuT+bR46eNDjskpwPssf0X7Bsw2XnWFquVEidc8Lb7/YSiv7uUKw9Dk9GpnUCk1C/bl+gng3LYVXS4Ab3LeDAv+qjWgKBnCye9bfqqY3rPS7g+gF6mXs13V7e8UFipaAg==',key_name='tempest-keypair-165420657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-0e1xs3iz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=01f2b21c-7e4f-45c0-9677-fdd7baec0b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:73:7e,bridge_name='br-int',has_traffic_filtering=True,id=c1caa4a4-4e55-49ab-b581-4e6c9783f17e,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1caa4a4-4e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'pci_devices' on Instance uuid 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:46:18 user nova-compute[72998]:   <uuid>01f2b21c-7e4f-45c0-9677-fdd7baec0b7b</uuid>
Aug 17 08:46:18 user nova-compute[72998]:   <name>instance-0000002a</name>
Aug 17 08:46:18 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:46:18 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:46:18 user nova-compute[72998]:   <metadata>
Aug 17 08:46:18 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:46:18 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:46:18 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1911427318</nova:name>
Aug 17 08:46:18 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:46:18</nova:creationTime>
Aug 17 08:46:18 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:46:18 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:46:18 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:46:18 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:46:18 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:46:18 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:46:18 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:46:18 user nova-compute[72998]:       <nova:owner>
Aug 17 08:46:18 user nova-compute[72998]:         <nova:user uuid="ad6fa0f0675942b18c911f61e39bf71d">tempest-AttachVolumeNegativeTest-1248035146-project-member</nova:user>
Aug 17 08:46:18 user nova-compute[72998]:         <nova:project uuid="91f2b81f590b4c05bde54a7669412ac3">tempest-AttachVolumeNegativeTest-1248035146</nova:project>
Aug 17 08:46:18 user nova-compute[72998]:       </nova:owner>
Aug 17 08:46:18 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:46:18 user nova-compute[72998]:       <nova:ports>
Aug 17 08:46:18 user nova-compute[72998]:         <nova:port uuid="c1caa4a4-4e55-49ab-b581-4e6c9783f17e">
Aug 17 08:46:18 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 08:46:18 user nova-compute[72998]:         </nova:port>
Aug 17 08:46:18 user nova-compute[72998]:       </nova:ports>
Aug 17 08:46:18 user nova-compute[72998]:     </nova:instance>
Aug 17 08:46:18 user nova-compute[72998]:   </metadata>
Aug 17 08:46:18 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:46:18 user nova-compute[72998]:     <system>
Aug 17 08:46:18 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:46:18 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:46:18 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:46:18 user nova-compute[72998]:       <entry name="serial">01f2b21c-7e4f-45c0-9677-fdd7baec0b7b</entry>
Aug 17 08:46:18 user nova-compute[72998]:       <entry name="uuid">01f2b21c-7e4f-45c0-9677-fdd7baec0b7b</entry>
Aug 17 08:46:18 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:46:18 user nova-compute[72998]:     </system>
Aug 17 08:46:18 user nova-compute[72998]:   </sysinfo>
Aug 17 08:46:18 user nova-compute[72998]:   <os>
Aug 17 08:46:18 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:46:18 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:46:18 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:46:18 user nova-compute[72998]:   </os>
Aug 17 08:46:18 user nova-compute[72998]:   <features>
Aug 17 08:46:18 user nova-compute[72998]:     <acpi/>
Aug 17 08:46:18 user nova-compute[72998]:     <apic/>
Aug 17 08:46:18 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:46:18 user nova-compute[72998]:   </features>
Aug 17 08:46:18 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:46:18 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:46:18 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:46:18 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:46:18 user nova-compute[72998]:   </clock>
Aug 17 08:46:18 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:46:18 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:46:18 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:46:18 user nova-compute[72998]:   </cpu>
Aug 17 08:46:18 user nova-compute[72998]:   <devices>
Aug 17 08:46:18 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:46:18 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:46:18 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk"/>
Aug 17 08:46:18 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:46:18 user nova-compute[72998]:     </disk>
Aug 17 08:46:18 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:46:18 user nova-compute[72998]:       <mac address="fa:16:3e:23:73:7e"/>
Aug 17 08:46:18 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:46:18 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:46:18 user nova-compute[72998]:       <target dev="tapc1caa4a4-4e"/>
Aug 17 08:46:18 user nova-compute[72998]:     </interface>
Aug 17 08:46:18 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:46:18 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/console.log" append="off"/>
Aug 17 08:46:18 user nova-compute[72998]:     </serial>
Aug 17 08:46:18 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:46:18 user nova-compute[72998]:     <video>
Aug 17 08:46:18 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:46:18 user nova-compute[72998]:     </video>
Aug 17 08:46:18 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:46:18 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:46:18 user nova-compute[72998]:     </rng>
Aug 17 08:46:18 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:46:18 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:46:18 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:46:18 user nova-compute[72998]:     </memballoon>
Aug 17 08:46:18 user nova-compute[72998]:   </devices>
Aug 17 08:46:18 user nova-compute[72998]: </domain>
Aug 17 08:46:18 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911427318',display_name='tempest-AttachVolumeNegativeTest-server-1911427318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911427318',id=42,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuT+bR46eNDjskpwPssf0X7Bsw2XnWFquVEidc8Lb7/YSiv7uUKw9Dk9GpnUCk1C/bl+gng3LYVXS4Ab3LeDAv+qjWgKBnCye9bfqqY3rPS7g+gF6mXs13V7e8UFipaAg==',key_name='tempest-keypair-165420657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-0e1xs3iz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=01f2b21c-7e4f-45c0-9677-fdd7baec0b7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:73:7e,bridge_name='br-int',has_traffic_filtering=True,id=c1caa4a4-4e55-49ab-b581-4e6c9783f17e,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1caa4a4-4e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG os_vif [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:73:7e,bridge_name='br-int',has_traffic_filtering=True,id=c1caa4a4-4e55-49ab-b581-4e6c9783f17e,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1caa4a4-4e') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1caa4a4-4e, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1caa4a4-4e, col_values=(('external_ids', {'iface-id': 'c1caa4a4-4e55-49ab-b581-4e6c9783f17e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:73:7e', 'vm-uuid': '01f2b21c-7e4f-45c0-9677-fdd7baec0b7b'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:18 user nova-compute[72998]: INFO os_vif [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:73:7e,bridge_name='br-int',has_traffic_filtering=True,id=c1caa4a4-4e55-49ab-b581-4e6c9783f17e,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1caa4a4-4e')
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No VIF found with MAC fa:16:3e:23:73:7e, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-a877a85b-dcf8-4cfc-afed-7b661fa333c1 req-c011dba7-9baa-4877-9a38-4cde9840a5b8 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Updated VIF entry in instance network info cache for port c1caa4a4-4e55-49ab-b581-4e6c9783f17e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-a877a85b-dcf8-4cfc-afed-7b661fa333c1 req-c011dba7-9baa-4877-9a38-4cde9840a5b8 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Updating instance_info_cache with network_info: [{"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:46:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a877a85b-dcf8-4cfc-afed-7b661fa333c1 req-c011dba7-9baa-4877-9a38-4cde9840a5b8 service nova] Releasing lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:46:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-0f884681-1c52-4853-820c-55cfa386f695 req-8ceb6209-6bf2-4b74-bfbb-4aee24d4e744 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received event network-vif-plugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:46:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0f884681-1c52-4853-820c-55cfa386f695 req-8ceb6209-6bf2-4b74-bfbb-4aee24d4e744 service nova] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0f884681-1c52-4853-820c-55cfa386f695 req-8ceb6209-6bf2-4b74-bfbb-4aee24d4e744 service nova] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0f884681-1c52-4853-820c-55cfa386f695 req-8ceb6209-6bf2-4b74-bfbb-4aee24d4e744 service nova] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-0f884681-1c52-4853-820c-55cfa386f695 req-8ceb6209-6bf2-4b74-bfbb-4aee24d4e744 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] No waiting events found dispatching network-vif-plugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:46:19 user nova-compute[72998]: WARNING nova.compute.manager [req-0f884681-1c52-4853-820c-55cfa386f695 req-8ceb6209-6bf2-4b74-bfbb-4aee24d4e744 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received unexpected event network-vif-plugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e for instance with vm_state building and task_state spawning.
Aug 17 08:46:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261981.7647238, 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:46:21 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] VM Resumed (Lifecycle Event)
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:46:21 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Instance spawned successfully.
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:46:21 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692261981.7682784, 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:46:21 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] VM Started (Lifecycle Event)
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:46:21 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-13b68d98-3b7c-4d40-984e-1de5f6529195 req-a2401c5d-cf10-4fe4-9cc3-90f4627dabab service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received event network-vif-plugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-13b68d98-3b7c-4d40-984e-1de5f6529195 req-a2401c5d-cf10-4fe4-9cc3-90f4627dabab service nova] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-13b68d98-3b7c-4d40-984e-1de5f6529195 req-a2401c5d-cf10-4fe4-9cc3-90f4627dabab service nova] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-13b68d98-3b7c-4d40-984e-1de5f6529195 req-a2401c5d-cf10-4fe4-9cc3-90f4627dabab service nova] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.compute.manager [req-13b68d98-3b7c-4d40-984e-1de5f6529195 req-a2401c5d-cf10-4fe4-9cc3-90f4627dabab service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] No waiting events found dispatching network-vif-plugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:46:21 user nova-compute[72998]: WARNING nova.compute.manager [req-13b68d98-3b7c-4d40-984e-1de5f6529195 req-a2401c5d-cf10-4fe4-9cc3-90f4627dabab service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received unexpected event network-vif-plugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e for instance with vm_state building and task_state spawning.
Aug 17 08:46:21 user nova-compute[72998]: INFO nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 17 08:46:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:46:21 user nova-compute[72998]: INFO nova.compute.manager [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Took 6.57 seconds to build instance.
Aug 17 08:46:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1eb35e4e-8f5f-462e-b8de-2547fa43c524 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.672s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:23 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:26 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:26 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:46:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:46:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:46:28 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:46:28 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:46:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=24.096691131591797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:46:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:46:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:46:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:46:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:46:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:46:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:46:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:46:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:46:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:47:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:47:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:47:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:47:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:47:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:47:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:47:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:47:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:47:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:47:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:47:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:47:18 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:47:18 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:47:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:18 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:47:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:47:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:47:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:25 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:47:26 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:47:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:47:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:47:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:47:26 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:47:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:47:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:47:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:47:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:47:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:47:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:47:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:47:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:47:28 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:47:28 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:47:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.040447235107422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:47:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:47:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:47:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:47:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:47:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:47:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:47:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:47:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:47:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:47:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:47:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:47:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:47:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:47:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:47:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:47:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:47:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:47:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:47:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:47:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:47:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:47:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:47:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'flavor' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:01 user nova-compute[72998]: INFO nova.compute.manager [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Attaching volume 53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 to /dev/vdb
Aug 17 08:48:01 user nova-compute[72998]: DEBUG os_brick.utils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1921352-5eaa-484d-af6c-8114c8bc12b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fa51ec-66d3-4e77-b0c6-2c57b5b43962]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bc9b58-4aee-455a-9459-d8ceaef09918]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[093edfaf-30c3-4fd0-a17b-971dca9d53b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:48:01 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:48:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c3933d-6abc-4e67-a53a-d8933755123d]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG os_brick.utils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:48:01 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating existing volume attachment record: b5e2b770-4077-4387-9333-e478bf549d88 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:48:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:48:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-c13284f0-67d5-40ed-a385-6017014afec0 req-3f06ed7a-ac1e-4103-b0a0-a23c7a92503a service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received event network-changed-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:48:06 user nova-compute[72998]: DEBUG nova.compute.manager [req-c13284f0-67d5-40ed-a385-6017014afec0 req-3f06ed7a-ac1e-4103-b0a0-a23c7a92503a service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Refreshing instance network info cache due to event network-changed-c1caa4a4-4e55-49ab-b581-4e6c9783f17e. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:48:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c13284f0-67d5-40ed-a385-6017014afec0 req-3f06ed7a-ac1e-4103-b0a0-a23c7a92503a service nova] Acquiring lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:48:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c13284f0-67d5-40ed-a385-6017014afec0 req-3f06ed7a-ac1e-4103-b0a0-a23c7a92503a service nova] Acquired lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:48:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-c13284f0-67d5-40ed-a385-6017014afec0 req-3f06ed7a-ac1e-4103-b0a0-a23c7a92503a service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Refreshing network info cache for port c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:48:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-c13284f0-67d5-40ed-a385-6017014afec0 req-3f06ed7a-ac1e-4103-b0a0-a23c7a92503a service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Updated VIF entry in instance network info cache for port c1caa4a4-4e55-49ab-b581-4e6c9783f17e. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:48:06 user nova-compute[72998]: DEBUG nova.network.neutron [req-c13284f0-67d5-40ed-a385-6017014afec0 req-3f06ed7a-ac1e-4103-b0a0-a23c7a92503a service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Updating instance_info_cache with network_info: [{"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:48:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c13284f0-67d5-40ed-a385-6017014afec0 req-3f06ed7a-ac1e-4103-b0a0-a23c7a92503a service nova] Releasing lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:48:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'flavor' on Instance uuid 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:10 user nova-compute[72998]: INFO nova.compute.manager [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Attaching volume 20aedf1d-9152-4dd3-bf1f-43b330e209b3 to /dev/vdb
Aug 17 08:48:10 user nova-compute[72998]: DEBUG os_brick.utils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa0a83b-ff88-4a12-b449-415643076115]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef65025-dfff-4062-99f1-fddae1bf5d83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d31c43-0715-43ac-954a-07275dc7b757]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f8b9b8-a822-497f-a0ee-e27f8bf8a461]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:48:10 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:48:10 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f0d10e-71f7-41bb-986f-46155c00c78f]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG os_brick.utils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:48:10 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Updating existing volume attachment record: 42666608-8d62-4aea-8dce-020a427ef164 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvbhaPjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:48:11 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:48:11 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:48:11 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d675e2-fd0c-4f3d-a307-a365bc3088ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:48:11 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4627b77-e877-46df-b8c5-204f5032c437]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63] added
Aug 17 08:48:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2808adb-230e-4fef-abcd-f1dd96b21ea5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b2c5d1-cefe-4e62-a02b-06a2e9f56e3b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvbhaPjB {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvbhaPjB" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b446912c-9850-4a54-98e7-435776d65659]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GvbhaPjB'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d27477-f6af-4b6f-a4e2-a4ffe7c8a90a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f1a0c4-276e-4066-9dc5-6197c402cfe3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:48:11 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:48:11 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:48:11 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:48:11 user nova-compute[72998]: 
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b01675f-490c-41e2-a82b-d664af887a56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63, portal: 172.16.0.220,3260]
Aug 17 08:48:11 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63, portal: 172.16.0.220,3260] successful.
Aug 17 08:48:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac4858e-1298-46c7-947d-7cf9a04a906d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb0dae7-63f5-44ad-adda-662d040b1d14]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:48:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:48:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a1ae66-4c65-4594-a0af-64d0947f8842]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:11 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:48:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:48:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvbhaPjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:48:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:48:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26533303932623432', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:48:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533303932623432', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:48:12 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'flavor' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:48:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:48:12 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:48:12 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:48:12 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:48:12 user nova-compute[72998]:   <serial>53a1d92e-8e5b-4ef7-a1e1-e79c60482a63</serial>
Aug 17 08:48:12 user nova-compute[72998]: </disk>
Aug 17 08:48:12 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:48:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:48:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:48:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] No VIF found with MAC fa:16:3e:5b:d4:ae, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:48:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4e40c186-834f-4688-afde-586e662b8c30 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.921s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-8f4a78c0-34b8-4530-aaf4-832addac1dd6 req-f8cc0859-a254-457e-837d-9e0fcb0cd84b service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:48:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-8f4a78c0-34b8-4530-aaf4-832addac1dd6 req-f8cc0859-a254-457e-837d-9e0fcb0cd84b service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing instance network info cache due to event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:48:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8f4a78c0-34b8-4530-aaf4-832addac1dd6 req-f8cc0859-a254-457e-837d-9e0fcb0cd84b service nova] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:48:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8f4a78c0-34b8-4530-aaf4-832addac1dd6 req-f8cc0859-a254-457e-837d-9e0fcb0cd84b service nova] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:48:16 user nova-compute[72998]: DEBUG nova.network.neutron [req-8f4a78c0-34b8-4530-aaf4-832addac1dd6 req-f8cc0859-a254-457e-837d-9e0fcb0cd84b service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:48:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:17 user nova-compute[72998]: DEBUG nova.network.neutron [req-8f4a78c0-34b8-4530-aaf4-832addac1dd6 req-f8cc0859-a254-457e-837d-9e0fcb0cd84b service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updated VIF entry in instance network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:48:17 user nova-compute[72998]: DEBUG nova.network.neutron [req-8f4a78c0-34b8-4530-aaf4-832addac1dd6 req-f8cc0859-a254-457e-837d-9e0fcb0cd84b service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:48:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8f4a78c0-34b8-4530-aaf4-832addac1dd6 req-f8cc0859-a254-457e-837d-9e0fcb0cd84b service nova] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:48:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:18 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:18 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:48:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:48:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:48:18 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-9626cc2c-849d-4ddf-b1ff-359c8109537a req-5f851af0-5c86-4ac2-9347-bcdff45317c7 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG nova.compute.manager [req-9626cc2c-849d-4ddf-b1ff-359c8109537a req-5f851af0-5c86-4ac2-9347-bcdff45317c7 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing instance network info cache due to event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9626cc2c-849d-4ddf-b1ff-359c8109537a req-5f851af0-5c86-4ac2-9347-bcdff45317c7 service nova] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9626cc2c-849d-4ddf-b1ff-359c8109537a req-5f851af0-5c86-4ac2-9347-bcdff45317c7 service nova] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG nova.network.neutron [req-9626cc2c-849d-4ddf-b1ff-359c8109537a req-5f851af0-5c86-4ac2-9347-bcdff45317c7 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:19 user nova-compute[72998]: INFO nova.compute.manager [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Rebooting instance
Aug 17 08:48:19 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Updating instance_info_cache with network_info: [{"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG nova.network.neutron [req-9626cc2c-849d-4ddf-b1ff-359c8109537a req-5f851af0-5c86-4ac2-9347-bcdff45317c7 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updated VIF entry in instance network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG nova.network.neutron [req-9626cc2c-849d-4ddf-b1ff-359c8109537a req-5f851af0-5c86-4ac2-9347-bcdff45317c7 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9626cc2c-849d-4ddf-b1ff-359c8109537a req-5f851af0-5c86-4ac2-9347-bcdff45317c7 service nova] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:48:19 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:48:20 user nova-compute[72998]: DEBUG nova.network.neutron [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:48:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:48:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTzZEADM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:48:21 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:48:21 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:48:21 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7241161-56a5-4b15-9af3-1bd8af17256e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:48:21 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e8016-94bd-4d3c-a401-31bb1aafa910]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3] added
Aug 17 08:48:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71424d0-ff1c-40ce-9a6c-d1608549f794]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[43708fd1-7dc9-402a-8cc7-79d0d7c287ad]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTzZEADM {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTzZEADM" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[298face5-8544-4b83-b825-559142b34c04]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xTzZEADM'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af796e-4970-47fd-81a9-a3432a178ea3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[48539bf4-fb05-457e-b2f7-0f436a9e8bf7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:48:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:48:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0543e4cb-f7c6-465f-9071-5d30832bda9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3, portal: 172.16.0.220,3260]
Aug 17 08:48:21 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3, portal: 172.16.0.220,3260] successful.
Aug 17 08:48:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ea4da-9ac5-4062-a241-c603e8265ca9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6943b8bf-1cfa-47fd-8fa8-123d5c91fec3]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:48:21 user nova-compute[72998]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 (non-flash)
Aug 17 08:48:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:48:21 user nova-compute[72998]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 (non-flash)
Aug 17 08:48:21 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b77da1a-941d-4a43-9ed1-074508145ad4]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:48:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTzZEADM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23536323033633963', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536323033633963', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-d224c75a-6f17-4d60-b69e-6d18c41b7967 req-7fabb95a-210e-409e-938b-5ce9dac6bdaa service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-unplugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d224c75a-6f17-4d60-b69e-6d18c41b7967 req-7fabb95a-210e-409e-938b-5ce9dac6bdaa service nova] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d224c75a-6f17-4d60-b69e-6d18c41b7967 req-7fabb95a-210e-409e-938b-5ce9dac6bdaa service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d224c75a-6f17-4d60-b69e-6d18c41b7967 req-7fabb95a-210e-409e-938b-5ce9dac6bdaa service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG nova.compute.manager [req-d224c75a-6f17-4d60-b69e-6d18c41b7967 req-7fabb95a-210e-409e-938b-5ce9dac6bdaa service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] No waiting events found dispatching network-vif-unplugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:48:22 user nova-compute[72998]: WARNING nova.compute.manager [req-d224c75a-6f17-4d60-b69e-6d18c41b7967 req-7fabb95a-210e-409e-938b-5ce9dac6bdaa service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received unexpected event network-vif-unplugged-5862e0ac-f719-40ec-b253-388148b78aa5 for instance with vm_state active and task_state reboot_started.
Aug 17 08:48:22 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'flavor' on Instance uuid 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:48:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:48:22 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:48:22 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:48:22 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:48:22 user nova-compute[72998]:   <serial>20aedf1d-9152-4dd3-bf1f-43b330e209b3</serial>
Aug 17 08:48:22 user nova-compute[72998]: </disk>
Aug 17 08:48:22 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:48:23 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Instance shutdown successfully.
Aug 17 08:48:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:48:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:48:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No VIF found with MAC fa:16:3e:23:73:7e, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:48:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c37db749-b7c7-48cf-b847-51081d4a169d tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.155s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:24 user nova-compute[72998]: INFO nova.compute.manager [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Detaching volume 20aedf1d-9152-4dd3-bf1f-43b330e209b3
Aug 17 08:48:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:24 user nova-compute[72998]: INFO nova.virt.block_device [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Attempting to driver detach volume 20aedf1d-9152-4dd3-bf1f-43b330e209b3 from mountpoint /dev/vdb
Aug 17 08:48:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Attempting to detach device vdb from instance 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:48:24 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:48:24 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:48:24 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:48:24 user nova-compute[72998]:   <serial>20aedf1d-9152-4dd3-bf1f-43b330e209b3</serial>
Aug 17 08:48:24 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:48:24 user nova-compute[72998]: </disk>
Aug 17 08:48:24 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:48:24 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully detached device vdb from instance 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b from the persistent domain config.
Aug 17 08:48:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:48:24 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:48:24 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:48:24 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:48:24 user nova-compute[72998]:   <serial>20aedf1d-9152-4dd3-bf1f-43b330e209b3</serial>
Aug 17 08:48:24 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:48:24 user nova-compute[72998]: </disk>
Aug 17 08:48:24 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-339a28f4-2c94-4c10-a085-0a84b305db39 req-ef7dca1e-cdf7-4c37-a918-d1450e6f8095 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-339a28f4-2c94-4c10-a085-0a84b305db39 req-ef7dca1e-cdf7-4c37-a918-d1450e6f8095 service nova] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-339a28f4-2c94-4c10-a085-0a84b305db39 req-ef7dca1e-cdf7-4c37-a918-d1450e6f8095 service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-339a28f4-2c94-4c10-a085-0a84b305db39 req-ef7dca1e-cdf7-4c37-a918-d1450e6f8095 service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-339a28f4-2c94-4c10-a085-0a84b305db39 req-ef7dca1e-cdf7-4c37-a918-d1450e6f8095 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] No waiting events found dispatching network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:48:24 user nova-compute[72998]: WARNING nova.compute.manager [req-339a28f4-2c94-4c10-a085-0a84b305db39 req-ef7dca1e-cdf7-4c37-a918-d1450e6f8095 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received unexpected event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 for instance with vm_state active and task_state reboot_started.
Aug 17 08:48:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692262105.1489663, 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:48:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully detached device vdb from instance 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b from the live domain config.
Aug 17 08:48:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTzZEADM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:48:25 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7a0757-237d-4ecd-94f6-f0fb11965b82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c520980-897f-45b9-8820-9bbd0480c5cd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:48:25 user nova-compute[72998]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 (non-flash)
Aug 17 08:48:25 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:48:25 user nova-compute[72998]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 (non-flash)
Aug 17 08:48:25 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488359000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[10114681-71b4-4446-8429-0e0e9f731c77]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05fcc9c-2232-486a-bdf7-abc76d723a5a]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f10816-56de-474c-8a54-4dddef756cc8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee210f4-28ea-4437-ab2d-421a715f1c70]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[627522c8-dd16-4093-999c-5927dd5165dd]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9480a14-78f6-4fcb-8f33-2f8751957c01]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3, portal: 172.16.0.220,3260]
Aug 17 08:48:25 user nova-compute[72998]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3, portal: 172.16.0.220,3260] successful.
Aug 17 08:48:25 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20aedf1d-9152-4dd3-bf1f-43b330e209b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4ffe8e-1041-4da7-99f2-4b710d9ebaae]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] <== disconnect_volume: return (268ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:48:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'flavor' on Instance uuid 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1ee46a30-b4f2-44af-a1fc-0b4628efcc61 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.878s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] No waiting events found dispatching network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:48:26 user nova-compute[72998]: WARNING nova.compute.manager [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received unexpected event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 for instance with vm_state active and task_state reboot_started.
Aug 17 08:48:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] No waiting events found dispatching network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:48:26 user nova-compute[72998]: WARNING nova.compute.manager [req-fe409a60-0598-4729-b4ce-d95260ac25e1 req-e7c5b3eb-a571-4d4f-adfe-46a782c17c7f service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received unexpected event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 for instance with vm_state active and task_state reboot_started.
Aug 17 08:48:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Removed pending event for 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 due to event {{(pid=72998) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 08:48:27 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262107.0251055, 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:48:27 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] VM Resumed (Lifecycle Event)
Aug 17 08:48:27 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Instance running successfully.
Aug 17 08:48:27 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Instance soft rebooted successfully.
Aug 17 08:48:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:48:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:48:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:48:27 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 17 08:48:27 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262107.0265152, 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:48:27 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] VM Started (Lifecycle Event)
Aug 17 08:48:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:48:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5dbecc7d-b684-4873-a332-d0d5885b8265 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.667s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:48:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:28 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:48:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:48:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:48:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:48:30 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:48:30 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:48:30 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=24.03809356689453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:48:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:48:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:48:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:34 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:48:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:48:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:48:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:48:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:48:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:48:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:49:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:49:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:49:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:49:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:49:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:49:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:49:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:49:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:49:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:49:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:49:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:49:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:49:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:49:14 user nova-compute[72998]: INFO nova.compute.manager [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Terminating instance
Aug 17 08:49:14 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:49:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-462a6aa7-eaf7-479b-8586-299a4dc8ef4f req-f9a037c8-2fa8-4534-b3b7-30c5ea9b05c8 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received event network-vif-unplugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-462a6aa7-eaf7-479b-8586-299a4dc8ef4f req-f9a037c8-2fa8-4534-b3b7-30c5ea9b05c8 service nova] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-462a6aa7-eaf7-479b-8586-299a4dc8ef4f req-f9a037c8-2fa8-4534-b3b7-30c5ea9b05c8 service nova] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-462a6aa7-eaf7-479b-8586-299a4dc8ef4f req-f9a037c8-2fa8-4534-b3b7-30c5ea9b05c8 service nova] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-462a6aa7-eaf7-479b-8586-299a4dc8ef4f req-f9a037c8-2fa8-4534-b3b7-30c5ea9b05c8 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] No waiting events found dispatching network-vif-unplugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-462a6aa7-eaf7-479b-8586-299a4dc8ef4f req-f9a037c8-2fa8-4534-b3b7-30c5ea9b05c8 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received event network-vif-unplugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:49:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Instance destroyed successfully.
Aug 17 08:49:15 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'resources' on Instance uuid 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911427318',display_name='tempest-AttachVolumeNegativeTest-server-1911427318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911427318',id=42,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuT+bR46eNDjskpwPssf0X7Bsw2XnWFquVEidc8Lb7/YSiv7uUKw9Dk9GpnUCk1C/bl+gng3LYVXS4Ab3LeDAv+qjWgKBnCye9bfqqY3rPS7g+gF6mXs13V7e8UFipaAg==',key_name='tempest-keypair-165420657',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:46:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-0e1xs3iz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=01f2b21c-7e4f-45c0-9677-fdd7baec0b7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "address": "fa:16:3e:23:73:7e", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1caa4a4-4e", "ovs_interfaceid": "c1caa4a4-4e55-49ab-b581-4e6c9783f17e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:73:7e,bridge_name='br-int',has_traffic_filtering=True,id=c1caa4a4-4e55-49ab-b581-4e6c9783f17e,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1caa4a4-4e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG os_vif [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:73:7e,bridge_name='br-int',has_traffic_filtering=True,id=c1caa4a4-4e55-49ab-b581-4e6c9783f17e,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1caa4a4-4e') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1caa4a4-4e, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:49:15 user nova-compute[72998]: INFO os_vif [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:73:7e,bridge_name='br-int',has_traffic_filtering=True,id=c1caa4a4-4e55-49ab-b581-4e6c9783f17e,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1caa4a4-4e')
Aug 17 08:49:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Deleting instance files /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b_del
Aug 17 08:49:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Deletion of /opt/stack/data/nova/instances/01f2b21c-7e4f-45c0-9677-fdd7baec0b7b_del complete
Aug 17 08:49:15 user nova-compute[72998]: INFO nova.compute.manager [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 08:49:15 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:49:15 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:49:16 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:49:16 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Took 0.97 seconds to deallocate network for instance.
Aug 17 08:49:16 user nova-compute[72998]: DEBUG nova.compute.manager [req-ead755c2-60dd-4abf-802b-e5924ae31f35 req-6e078ea5-1b8a-463b-944a-8a5116a24ad9 service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received event network-vif-deleted-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:49:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:49:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:49:16 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:49:16 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:49:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:49:17 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Deleted allocations for instance 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b
Aug 17 08:49:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2e6dbec8-ec83-4f45-8cc7-ddd93065b326 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.156s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:49:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-29fc2747-e816-4b30-848d-f52eaadb1ef1 req-fbc7140a-ca0d-46ce-aead-9bebbb71a1bd service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received event network-vif-plugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:49:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-29fc2747-e816-4b30-848d-f52eaadb1ef1 req-fbc7140a-ca0d-46ce-aead-9bebbb71a1bd service nova] Acquiring lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:49:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-29fc2747-e816-4b30-848d-f52eaadb1ef1 req-fbc7140a-ca0d-46ce-aead-9bebbb71a1bd service nova] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:49:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-29fc2747-e816-4b30-848d-f52eaadb1ef1 req-fbc7140a-ca0d-46ce-aead-9bebbb71a1bd service nova] Lock "01f2b21c-7e4f-45c0-9677-fdd7baec0b7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:49:17 user nova-compute[72998]: DEBUG nova.compute.manager [req-29fc2747-e816-4b30-848d-f52eaadb1ef1 req-fbc7140a-ca0d-46ce-aead-9bebbb71a1bd service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] No waiting events found dispatching network-vif-plugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:49:17 user nova-compute[72998]: WARNING nova.compute.manager [req-29fc2747-e816-4b30-848d-f52eaadb1ef1 req-fbc7140a-ca0d-46ce-aead-9bebbb71a1bd service nova] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Received unexpected event network-vif-plugged-c1caa4a4-4e55-49ab-b581-4e6c9783f17e for instance with vm_state deleted and task_state None.
Aug 17 08:49:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:20 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:49:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:49:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:49:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:49:20 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:49:20 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:49:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:49:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:49:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:49:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:49:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:30 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692262155.6600246, 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:49:30 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] VM Stopped (Lifecycle Event)
Aug 17 08:49:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dd6ccd0b-b3ac-4aab-baee-881550e55ba7 None None] [instance: 01f2b21c-7e4f-45c0-9677-fdd7baec0b7b] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:49:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:49:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:49:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:49:30 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:49:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:49:31 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:49:31 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:49:31 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=24.0572509765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:49:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:49:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:49:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:49:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:38 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:49:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:49:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Verify base images {{(pid=72998) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Image id 0bda9120-3bb6-44f0-ad16-144c41c77c97 yields fingerprint 839b860bda49e965de223da4b96ee91b344727c2 {{(pid=72998) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 08:49:52 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] image 0bda9120-3bb6-44f0-ad16-144c41c77c97 at (/opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2): checking
Aug 17 08:49:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] image 0bda9120-3bb6-44f0-ad16-144c41c77c97 at (/opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2): image is in use {{(pid=72998) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72998) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 is a valid instance name {{(pid=72998) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 has a disk file {{(pid=72998) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 08:49:52 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:49:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:49:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 is backed by 839b860bda49e965de223da4b96ee91b344727c2 {{(pid=72998) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 08:49:53 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650
Aug 17 08:49:53 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b
Aug 17 08:49:53 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429
Aug 17 08:49:53 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269
Aug 17 08:49:53 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510
Aug 17 08:49:53 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97
Aug 17 08:49:53 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569
Aug 17 08:49:53 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a
Aug 17 08:49:53 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Active base files: /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Removable base files: /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650 /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510 /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97 /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569 /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a
Aug 17 08:49:53 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c
Aug 17 08:49:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Verification complete {{(pid=72998) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 08:49:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Verify swap images {{(pid=72998) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 08:49:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Verify ephemeral images {{(pid=72998) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 08:49:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:50:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:50:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:08 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:50:08 user nova-compute[72998]: INFO nova.compute.claims [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Claim successful on node user
Aug 17 08:50:09 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:50:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:50:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG nova.policy [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad6fa0f0675942b18c911f61e39bf71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f2b81f590b4c05bde54a7669412ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:50:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Creating image(s)
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "/opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "/opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "/opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk 1073741824" returned: 0 in 0.054s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Successfully created port: a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Cannot resize image /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'migration_context' on Instance uuid 63dba48d-6fa5-4c97-bb9a-41845041c7df {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Ensure instance console log exists: /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:50:10 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Successfully updated port: a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquired lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-38b11475-9eed-4385-9390-ce23ac71c45c req-99f0418f-3e74-4f99-9333-a23acd345f4d service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received event network-changed-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-38b11475-9eed-4385-9390-ce23ac71c45c req-99f0418f-3e74-4f99-9333-a23acd345f4d service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Refreshing instance network info cache due to event network-changed-a3fd1153-ffe4-4c12-a303-031a6ff052e4. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-38b11475-9eed-4385-9390-ce23ac71c45c req-99f0418f-3e74-4f99-9333-a23acd345f4d service nova] Acquiring lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.neutron [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updating instance_info_cache with network_info: [{"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Releasing lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Instance network_info: |[{"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-38b11475-9eed-4385-9390-ce23ac71c45c req-99f0418f-3e74-4f99-9333-a23acd345f4d service nova] Acquired lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.neutron [req-38b11475-9eed-4385-9390-ce23ac71c45c req-99f0418f-3e74-4f99-9333-a23acd345f4d service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Refreshing network info cache for port a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Start _get_guest_xml network_info=[{"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:50:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:50:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-932613884',display_name='tempest-AttachVolumeNegativeTest-server-932613884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-932613884',id=43,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGJ0NsqKVt7KSJSckTpcCT+wHbu9vJHkV6TJ6HVciQ0FZQ+veTWE8+p0b+4Nv4XwxlxFUmNzr6Wil/1vSKsRLDYz8kp5FUvRcnfBYmm6ZSizyBgGbhxBfeSs8463qM/MQ==',key_name='tempest-keypair-1713961864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-z0ilo8wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=63dba48d-6fa5-4c97-bb9a-41845041c7df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:3f:f4,bridge_name='br-int',has_traffic_filtering=True,id=a3fd1153-ffe4-4c12-a303-031a6ff052e4,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fd1153-ff') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'pci_devices' on Instance uuid 63dba48d-6fa5-4c97-bb9a-41845041c7df {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:50:11 user nova-compute[72998]:   <uuid>63dba48d-6fa5-4c97-bb9a-41845041c7df</uuid>
Aug 17 08:50:11 user nova-compute[72998]:   <name>instance-0000002b</name>
Aug 17 08:50:11 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:50:11 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:50:11 user nova-compute[72998]:   <metadata>
Aug 17 08:50:11 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:50:11 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:50:11 user nova-compute[72998]:       <nova:name>tempest-AttachVolumeNegativeTest-server-932613884</nova:name>
Aug 17 08:50:11 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:50:11</nova:creationTime>
Aug 17 08:50:11 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:50:11 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:50:11 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:50:11 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:50:11 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:50:11 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:50:11 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:50:11 user nova-compute[72998]:       <nova:owner>
Aug 17 08:50:11 user nova-compute[72998]:         <nova:user uuid="ad6fa0f0675942b18c911f61e39bf71d">tempest-AttachVolumeNegativeTest-1248035146-project-member</nova:user>
Aug 17 08:50:11 user nova-compute[72998]:         <nova:project uuid="91f2b81f590b4c05bde54a7669412ac3">tempest-AttachVolumeNegativeTest-1248035146</nova:project>
Aug 17 08:50:11 user nova-compute[72998]:       </nova:owner>
Aug 17 08:50:11 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:50:11 user nova-compute[72998]:       <nova:ports>
Aug 17 08:50:11 user nova-compute[72998]:         <nova:port uuid="a3fd1153-ffe4-4c12-a303-031a6ff052e4">
Aug 17 08:50:11 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 08:50:11 user nova-compute[72998]:         </nova:port>
Aug 17 08:50:11 user nova-compute[72998]:       </nova:ports>
Aug 17 08:50:11 user nova-compute[72998]:     </nova:instance>
Aug 17 08:50:11 user nova-compute[72998]:   </metadata>
Aug 17 08:50:11 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:50:11 user nova-compute[72998]:     <system>
Aug 17 08:50:11 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:50:11 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:50:11 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:50:11 user nova-compute[72998]:       <entry name="serial">63dba48d-6fa5-4c97-bb9a-41845041c7df</entry>
Aug 17 08:50:11 user nova-compute[72998]:       <entry name="uuid">63dba48d-6fa5-4c97-bb9a-41845041c7df</entry>
Aug 17 08:50:11 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:50:11 user nova-compute[72998]:     </system>
Aug 17 08:50:11 user nova-compute[72998]:   </sysinfo>
Aug 17 08:50:11 user nova-compute[72998]:   <os>
Aug 17 08:50:11 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:50:11 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:50:11 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:50:11 user nova-compute[72998]:   </os>
Aug 17 08:50:11 user nova-compute[72998]:   <features>
Aug 17 08:50:11 user nova-compute[72998]:     <acpi/>
Aug 17 08:50:11 user nova-compute[72998]:     <apic/>
Aug 17 08:50:11 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:50:11 user nova-compute[72998]:   </features>
Aug 17 08:50:11 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:50:11 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:50:11 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:50:11 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:50:11 user nova-compute[72998]:   </clock>
Aug 17 08:50:11 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:50:11 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:50:11 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:50:11 user nova-compute[72998]:   </cpu>
Aug 17 08:50:11 user nova-compute[72998]:   <devices>
Aug 17 08:50:11 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:50:11 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:50:11 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk"/>
Aug 17 08:50:11 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:50:11 user nova-compute[72998]:     </disk>
Aug 17 08:50:11 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:50:11 user nova-compute[72998]:       <mac address="fa:16:3e:5b:3f:f4"/>
Aug 17 08:50:11 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:50:11 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:50:11 user nova-compute[72998]:       <target dev="tapa3fd1153-ff"/>
Aug 17 08:50:11 user nova-compute[72998]:     </interface>
Aug 17 08:50:11 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:50:11 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/console.log" append="off"/>
Aug 17 08:50:11 user nova-compute[72998]:     </serial>
Aug 17 08:50:11 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:50:11 user nova-compute[72998]:     <video>
Aug 17 08:50:11 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:50:11 user nova-compute[72998]:     </video>
Aug 17 08:50:11 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:50:11 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:50:11 user nova-compute[72998]:     </rng>
Aug 17 08:50:11 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:50:11 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:50:11 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:50:11 user nova-compute[72998]:     </memballoon>
Aug 17 08:50:11 user nova-compute[72998]:   </devices>
Aug 17 08:50:11 user nova-compute[72998]: </domain>
Aug 17 08:50:11 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-932613884',display_name='tempest-AttachVolumeNegativeTest-server-932613884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-932613884',id=43,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGJ0NsqKVt7KSJSckTpcCT+wHbu9vJHkV6TJ6HVciQ0FZQ+veTWE8+p0b+4Nv4XwxlxFUmNzr6Wil/1vSKsRLDYz8kp5FUvRcnfBYmm6ZSizyBgGbhxBfeSs8463qM/MQ==',key_name='tempest-keypair-1713961864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-z0ilo8wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=63dba48d-6fa5-4c97-bb9a-41845041c7df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:3f:f4,bridge_name='br-int',has_traffic_filtering=True,id=a3fd1153-ffe4-4c12-a303-031a6ff052e4,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fd1153-ff') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG os_vif [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:3f:f4,bridge_name='br-int',has_traffic_filtering=True,id=a3fd1153-ffe4-4c12-a303-031a6ff052e4,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fd1153-ff') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3fd1153-ff, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3fd1153-ff, col_values=(('external_ids', {'iface-id': 'a3fd1153-ffe4-4c12-a303-031a6ff052e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:3f:f4', 'vm-uuid': '63dba48d-6fa5-4c97-bb9a-41845041c7df'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:11 user nova-compute[72998]: INFO os_vif [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:3f:f4,bridge_name='br-int',has_traffic_filtering=True,id=a3fd1153-ffe4-4c12-a303-031a6ff052e4,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fd1153-ff')
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No VIF found with MAC fa:16:3e:5b:3f:f4, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.neutron [req-38b11475-9eed-4385-9390-ce23ac71c45c req-99f0418f-3e74-4f99-9333-a23acd345f4d service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updated VIF entry in instance network info cache for port a3fd1153-ffe4-4c12-a303-031a6ff052e4. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:50:11 user nova-compute[72998]: DEBUG nova.network.neutron [req-38b11475-9eed-4385-9390-ce23ac71c45c req-99f0418f-3e74-4f99-9333-a23acd345f4d service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updating instance_info_cache with network_info: [{"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-38b11475-9eed-4385-9390-ce23ac71c45c req-99f0418f-3e74-4f99-9333-a23acd345f4d service nova] Releasing lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-cf09673e-c798-451e-8259-38557e9be3a6 req-30ac5ff3-cf00-4b13-8ff3-116070c74fa9 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG nova.compute.manager [req-cf09673e-c798-451e-8259-38557e9be3a6 req-30ac5ff3-cf00-4b13-8ff3-116070c74fa9 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing instance network info cache due to event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cf09673e-c798-451e-8259-38557e9be3a6 req-30ac5ff3-cf00-4b13-8ff3-116070c74fa9 service nova] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cf09673e-c798-451e-8259-38557e9be3a6 req-30ac5ff3-cf00-4b13-8ff3-116070c74fa9 service nova] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG nova.network.neutron [req-cf09673e-c798-451e-8259-38557e9be3a6 req-30ac5ff3-cf00-4b13-8ff3-116070c74fa9 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:12 user nova-compute[72998]: INFO nova.compute.manager [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Detaching volume 53a1d92e-8e5b-4ef7-a1e1-e79c60482a63
Aug 17 08:50:12 user nova-compute[72998]: INFO nova.virt.block_device [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Attempting to driver detach volume 53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 from mountpoint /dev/vdb
Aug 17 08:50:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Attempting to detach device vdb from instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:50:12 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:50:12 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:50:12 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:50:12 user nova-compute[72998]:   <serial>53a1d92e-8e5b-4ef7-a1e1-e79c60482a63</serial>
Aug 17 08:50:12 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:50:12 user nova-compute[72998]: </disk>
Aug 17 08:50:12 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:50:12 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully detached device vdb from instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 from the persistent domain config.
Aug 17 08:50:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:50:12 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:50:12 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:50:12 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:50:12 user nova-compute[72998]:   <serial>53a1d92e-8e5b-4ef7-a1e1-e79c60482a63</serial>
Aug 17 08:50:12 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:50:12 user nova-compute[72998]: </disk>
Aug 17 08:50:12 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG nova.network.neutron [req-cf09673e-c798-451e-8259-38557e9be3a6 req-30ac5ff3-cf00-4b13-8ff3-116070c74fa9 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updated VIF entry in instance network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG nova.network.neutron [req-cf09673e-c798-451e-8259-38557e9be3a6 req-30ac5ff3-cf00-4b13-8ff3-116070c74fa9 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-cf09673e-c798-451e-8259-38557e9be3a6 req-30ac5ff3-cf00-4b13-8ff3-116070c74fa9 service nova] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-0967f810-5a89-416e-85bf-470cd6f95967 req-9fbb321e-4530-4c48-9f21-158e2429c76d service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-0967f810-5a89-416e-85bf-470cd6f95967 req-9fbb321e-4530-4c48-9f21-158e2429c76d service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing instance network info cache due to event network-changed-5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0967f810-5a89-416e-85bf-470cd6f95967 req-9fbb321e-4530-4c48-9f21-158e2429c76d service nova] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0967f810-5a89-416e-85bf-470cd6f95967 req-9fbb321e-4530-4c48-9f21-158e2429c76d service nova] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.network.neutron [req-0967f810-5a89-416e-85bf-470cd6f95967 req-9fbb321e-4530-4c48-9f21-158e2429c76d service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Refreshing network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-86d17da3-0435-4cdc-abee-ba44a79cd10c req-0f3a8357-0732-4469-8110-5435cbe21453 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received event network-vif-plugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-86d17da3-0435-4cdc-abee-ba44a79cd10c req-0f3a8357-0732-4469-8110-5435cbe21453 service nova] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-86d17da3-0435-4cdc-abee-ba44a79cd10c req-0f3a8357-0732-4469-8110-5435cbe21453 service nova] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-86d17da3-0435-4cdc-abee-ba44a79cd10c req-0f3a8357-0732-4469-8110-5435cbe21453 service nova] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-86d17da3-0435-4cdc-abee-ba44a79cd10c req-0f3a8357-0732-4469-8110-5435cbe21453 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] No waiting events found dispatching network-vif-plugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:50:13 user nova-compute[72998]: WARNING nova.compute.manager [req-86d17da3-0435-4cdc-abee-ba44a79cd10c req-0f3a8357-0732-4469-8110-5435cbe21453 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received unexpected event network-vif-plugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 for instance with vm_state building and task_state spawning.
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692262213.2529998, 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:50:13 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully detached device vdb from instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 from the live domain config.
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvbhaPjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:50:13 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8757403a-1c31-4546-9e5c-cb805a1e526a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6eb794-4cd4-4a1e-bbc5-838e7e2965ed]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:50:13 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 (non-flash)
Aug 17 08:50:13 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4b46c6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1588650-eeb5-495d-b1e6-e49184be243d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[20451f49-74f9-43ab-bd21-ef5f44481af2]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa08bb2-e4ab-4080-9336-e91a8c842f0e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8b6287-124e-43d5-8582-08fa89e369a2]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[13096087-0bf4-464a-bc2d-d97be08ef13c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.network.neutron [req-0967f810-5a89-416e-85bf-470cd6f95967 req-9fbb321e-4530-4c48-9f21-158e2429c76d service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updated VIF entry in instance network info cache for port 5862e0ac-f719-40ec-b253-388148b78aa5. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.network.neutron [req-0967f810-5a89-416e-85bf-470cd6f95967 req-9fbb321e-4530-4c48-9f21-158e2429c76d service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0967f810-5a89-416e-85bf-470cd6f95967 req-9fbb321e-4530-4c48-9f21-158e2429c76d service nova] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae7810d-b18d-4057-8c4c-5dfeb373ed6e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63, portal: 172.16.0.220,3260]
Aug 17 08:50:13 user nova-compute[72998]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63, portal: 172.16.0.220,3260] successful.
Aug 17 08:50:13 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a1d92e-8e5b-4ef7-a1e1-e79c60482a63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[603089be-2b72-4f46-b175-b13a1fbdc881]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] <== disconnect_volume: return (362ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:50:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:50:14 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'flavor' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:50:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b7e8e190-ccf8-4de0-bde5-470105fd7de4 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.041s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-6a83bcd0-594b-4531-b8d6-3e904913f14b req-90f2a91e-1cef-4391-bc6c-04efee967062 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received event network-vif-plugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6a83bcd0-594b-4531-b8d6-3e904913f14b req-90f2a91e-1cef-4391-bc6c-04efee967062 service nova] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6a83bcd0-594b-4531-b8d6-3e904913f14b req-90f2a91e-1cef-4391-bc6c-04efee967062 service nova] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6a83bcd0-594b-4531-b8d6-3e904913f14b req-90f2a91e-1cef-4391-bc6c-04efee967062 service nova] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.compute.manager [req-6a83bcd0-594b-4531-b8d6-3e904913f14b req-90f2a91e-1cef-4391-bc6c-04efee967062 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] No waiting events found dispatching network-vif-plugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:50:15 user nova-compute[72998]: WARNING nova.compute.manager [req-6a83bcd0-594b-4531-b8d6-3e904913f14b req-90f2a91e-1cef-4391-bc6c-04efee967062 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received unexpected event network-vif-plugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 for instance with vm_state building and task_state spawning.
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262215.5262058, 63dba48d-6fa5-4c97-bb9a-41845041c7df => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:50:15 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] VM Resumed (Lifecycle Event)
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:50:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Instance spawned successfully.
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:50:15 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262215.527092, 63dba48d-6fa5-4c97-bb9a-41845041c7df => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:50:15 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] VM Started (Lifecycle Event)
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:50:15 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:50:15 user nova-compute[72998]: INFO nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 17 08:50:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:50:15 user nova-compute[72998]: INFO nova.compute.manager [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Took 6.79 seconds to build instance.
Aug 17 08:50:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1de0f04c-92f7-4660-9eae-b72eee55f9b1 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.887s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [{"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:50:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:50:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:50:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:50:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:50:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:50:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:32 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:50:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:50:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:50:34 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:50:34 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=24.029041290283203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 63dba48d-6fa5-4c97-bb9a-41845041c7df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:50:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:50:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:50:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 08:50:40 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:42 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 08:50:42 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 08:50:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:50:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:50:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:50:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:50:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:50:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:51 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:50:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:50:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:50:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:50:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:50:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:50:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:51:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:51:09 user nova-compute[72998]: INFO nova.compute.manager [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Terminating instance
Aug 17 08:51:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-8bb4b87d-7cbd-41ee-9bb9-1dc8ba07eac5 req-1d0fbe52-d1fb-468c-b2e3-41b84735e4b9 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-unplugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8bb4b87d-7cbd-41ee-9bb9-1dc8ba07eac5 req-1d0fbe52-d1fb-468c-b2e3-41b84735e4b9 service nova] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8bb4b87d-7cbd-41ee-9bb9-1dc8ba07eac5 req-1d0fbe52-d1fb-468c-b2e3-41b84735e4b9 service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8bb4b87d-7cbd-41ee-9bb9-1dc8ba07eac5 req-1d0fbe52-d1fb-468c-b2e3-41b84735e4b9 service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-8bb4b87d-7cbd-41ee-9bb9-1dc8ba07eac5 req-1d0fbe52-d1fb-468c-b2e3-41b84735e4b9 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] No waiting events found dispatching network-vif-unplugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:51:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-8bb4b87d-7cbd-41ee-9bb9-1dc8ba07eac5 req-1d0fbe52-d1fb-468c-b2e3-41b84735e4b9 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-unplugged-5862e0ac-f719-40ec-b253-388148b78aa5 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:10 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Instance destroyed successfully.
Aug 17 08:51:10 user nova-compute[72998]: DEBUG nova.objects.instance [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lazy-loading 'resources' on Instance uuid 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-332738239',display_name='tempest-TestMinimumBasicScenario-server-332738239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-332738239',id=41,image_ref='0bda9120-3bb6-44f0-ad16-144c41c77c97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLK9JtQ9qe1sxx+AxTTdJ62l6XfznpBYwgoc76iN18lIhKWGpNSD/a161gSU1Oywgt6/Tqoq++Q7/UcsNMSVTPWbyyrNpDG0fdnZNebcgQrTJoRh4JF5X3Kbb2JfHm2MA==',key_name='tempest-TestMinimumBasicScenario-1256484932',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd77c6b0783945e8b87fa60b07e5232b',ramdisk_id='',reservation_id='r-omf9p6ph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0bda9120-3bb6-44f0-ad16-144c41c77c97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2058599716',owner_user_name='tempest-TestMinimumBasicScenario-2058599716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:48:27Z,user_data=None,user_id='d05f5c4078974746b66bfa8506bdd7da',uuid=48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converting VIF {"id": "5862e0ac-f719-40ec-b253-388148b78aa5", "address": "fa:16:3e:5b:d4:ae", "network": {"id": "d151ae58-a000-4145-8a21-44f761ac61d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-156063599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd77c6b0783945e8b87fa60b07e5232b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5862e0ac-f7", "ovs_interfaceid": "5862e0ac-f719-40ec-b253-388148b78aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d4:ae,bridge_name='br-int',has_traffic_filtering=True,id=5862e0ac-f719-40ec-b253-388148b78aa5,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5862e0ac-f7') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG os_vif [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d4:ae,bridge_name='br-int',has_traffic_filtering=True,id=5862e0ac-f719-40ec-b253-388148b78aa5,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5862e0ac-f7') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5862e0ac-f7, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:51:10 user nova-compute[72998]: INFO os_vif [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d4:ae,bridge_name='br-int',has_traffic_filtering=True,id=5862e0ac-f719-40ec-b253-388148b78aa5,network=Network(d151ae58-a000-4145-8a21-44f761ac61d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5862e0ac-f7')
Aug 17 08:51:10 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Deleting instance files /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9_del
Aug 17 08:51:10 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Deletion of /opt/stack/data/nova/instances/48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9_del complete
Aug 17 08:51:10 user nova-compute[72998]: INFO nova.compute.manager [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 08:51:10 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:51:10 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:51:11 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Took 0.50 seconds to deallocate network for instance.
Aug 17 08:51:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-23e64b60-b20d-459e-8cc6-b3507525bc03 req-62a56ce3-bb2b-4c1d-b35a-ebd9a951a686 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-deleted-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:51:11 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Deleted allocations for instance 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9
Aug 17 08:51:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5b28470f-c315-4f58-b894-56c081a36b91 tempest-TestMinimumBasicScenario-2058599716 tempest-TestMinimumBasicScenario-2058599716-project-member] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.735s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-81131762-bbba-4e8c-83ab-211dede446c0 req-c28350e1-de99-4bc3-b6fb-0111aa5df346 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-81131762-bbba-4e8c-83ab-211dede446c0 req-c28350e1-de99-4bc3-b6fb-0111aa5df346 service nova] Acquiring lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-81131762-bbba-4e8c-83ab-211dede446c0 req-c28350e1-de99-4bc3-b6fb-0111aa5df346 service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-81131762-bbba-4e8c-83ab-211dede446c0 req-c28350e1-de99-4bc3-b6fb-0111aa5df346 service nova] Lock "48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:51:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-81131762-bbba-4e8c-83ab-211dede446c0 req-c28350e1-de99-4bc3-b6fb-0111aa5df346 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] No waiting events found dispatching network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:51:11 user nova-compute[72998]: WARNING nova.compute.manager [req-81131762-bbba-4e8c-83ab-211dede446c0 req-c28350e1-de99-4bc3-b6fb-0111aa5df346 service nova] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Received unexpected event network-vif-plugged-5862e0ac-f719-40ec-b253-388148b78aa5 for instance with vm_state deleted and task_state None.
Aug 17 08:51:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid 63dba48d-6fa5-4c97-bb9a-41845041c7df {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 08:51:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:51:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:51:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:51:20 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:51:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updating instance_info_cache with network_info: [{"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:51:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:51:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:51:25 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692262270.4233165, 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:51:25 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] VM Stopped (Lifecycle Event)
Aug 17 08:51:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6aa8b3af-4698-4da2-9743-0c6a14145413 None None] [instance: 48374705-ce7b-4bf6-a2d7-a3ca1b2df8e9] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:51:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:51:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:51:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:51:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:51:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:51:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:51:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:51:33 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:51:33 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:51:34 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:51:34 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:51:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=24.054584503173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 63dba48d-6fa5-4c97-bb9a-41845041c7df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:51:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:51:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:51:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:51:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:51:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:51:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:51:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:51:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:38 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:51:40 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:51:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:51:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:51:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-4c44ea2d-aab7-476e-b66d-223764f2b026 req-67176c71-2153-46b4-96b7-0d3d8be76fa2 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received event network-changed-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-4c44ea2d-aab7-476e-b66d-223764f2b026 req-67176c71-2153-46b4-96b7-0d3d8be76fa2 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Refreshing instance network info cache due to event network-changed-a3fd1153-ffe4-4c12-a303-031a6ff052e4. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4c44ea2d-aab7-476e-b66d-223764f2b026 req-67176c71-2153-46b4-96b7-0d3d8be76fa2 service nova] Acquiring lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4c44ea2d-aab7-476e-b66d-223764f2b026 req-67176c71-2153-46b4-96b7-0d3d8be76fa2 service nova] Acquired lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:52:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-4c44ea2d-aab7-476e-b66d-223764f2b026 req-67176c71-2153-46b4-96b7-0d3d8be76fa2 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Refreshing network info cache for port a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:52:01 user nova-compute[72998]: DEBUG nova.network.neutron [req-4c44ea2d-aab7-476e-b66d-223764f2b026 req-67176c71-2153-46b4-96b7-0d3d8be76fa2 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updated VIF entry in instance network info cache for port a3fd1153-ffe4-4c12-a303-031a6ff052e4. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:52:01 user nova-compute[72998]: DEBUG nova.network.neutron [req-4c44ea2d-aab7-476e-b66d-223764f2b026 req-67176c71-2153-46b4-96b7-0d3d8be76fa2 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updating instance_info_cache with network_info: [{"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:52:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4c44ea2d-aab7-476e-b66d-223764f2b026 req-67176c71-2153-46b4-96b7-0d3d8be76fa2 service nova] Releasing lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:52:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG nova.objects.instance [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'flavor' on Instance uuid 63dba48d-6fa5-4c97-bb9a-41845041c7df {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:05 user nova-compute[72998]: INFO nova.compute.manager [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Attaching volume c1137064-130c-4c2f-882b-d67352dae32d to /dev/vdb
Aug 17 08:52:05 user nova-compute[72998]: DEBUG os_brick.utils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d913f55-1f4f-4b80-982b-f5ba416ccc19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05b4a23-73ca-4d52-b267-a3a1bae12112]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[951445f3-5606-44fa-ad75-2bcb9ee16fb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d305bf3-a1ba-421a-afb0-517e5d5809f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:52:05 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:52:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f72002-7393-4102-81da-f51bda98c1e6]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG os_brick.utils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:52:05 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updating existing volume attachment record: ed139ea9-f03a-4db7-b23c-fd1ad7109643 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:52:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusSZqlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:52:16 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:52:16 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:52:16 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47e6e39-7d13-4273-9ac1-1c5fa2a14c8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:52:16 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c26396-a80e-4907-b359-91d2e720de23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d] added
Aug 17 08:52:16 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2c597b-1e0a-4ff6-a646-70e34e235c2d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e32de5-f11e-4fd4-9ae7-219fa14114fd]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nusSZqlM {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nusSZqlM" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[366c06c5-190d-4a1c-8f61-f5bdf1733a50]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nusSZqlM'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[45251f0b-e838-4212-b940-9f3fe8c2c6f1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1603182c-fae6-4b76-9ddc-1c0ff58c455f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:52:16 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:52:16 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:52:16 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:52:16 user nova-compute[72998]: 
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9968da-4c14-443c-bd1c-6a3db08cdb61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d, portal: 172.16.0.220,3260]
Aug 17 08:52:16 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d, portal: 172.16.0.220,3260] successful.
Aug 17 08:52:16 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[124c8623-2aa8-4103-b13f-b61160e18e4e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d36a1-4973-436a-95a5-be3bd9e45daa]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d (non-flash)
Aug 17 08:52:16 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d (non-flash)
Aug 17 08:52:16 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8da2bf-65e5-476e-aef6-8f19cff12b0f]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:52:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusSZqlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26534333631636337', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534333631636337', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG nova.objects.instance [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'flavor' on Instance uuid 63dba48d-6fa5-4c97-bb9a-41845041c7df {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:52:17 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:52:17 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:52:17 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:52:17 user nova-compute[72998]:   <serial>c1137064-130c-4c2f-882b-d67352dae32d</serial>
Aug 17 08:52:17 user nova-compute[72998]: </disk>
Aug 17 08:52:17 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:52:17 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] No VIF found with MAC fa:16:3e:5b:3f:f4, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:52:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-88299dee-5348-469d-b1ed-f59db010b997 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.504s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:18 user nova-compute[72998]: INFO nova.compute.manager [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Detaching volume c1137064-130c-4c2f-882b-d67352dae32d
Aug 17 08:52:18 user nova-compute[72998]: INFO nova.virt.block_device [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Attempting to driver detach volume c1137064-130c-4c2f-882b-d67352dae32d from mountpoint /dev/vdb
Aug 17 08:52:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Attempting to detach device vdb from instance 63dba48d-6fa5-4c97-bb9a-41845041c7df from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:52:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:52:18 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:52:18 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:52:18 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:52:18 user nova-compute[72998]:   <serial>c1137064-130c-4c2f-882b-d67352dae32d</serial>
Aug 17 08:52:18 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:52:18 user nova-compute[72998]: </disk>
Aug 17 08:52:18 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:52:18 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully detached device vdb from instance 63dba48d-6fa5-4c97-bb9a-41845041c7df from the persistent domain config.
Aug 17 08:52:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63dba48d-6fa5-4c97-bb9a-41845041c7df from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:52:18 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:52:18 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:52:18 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:52:18 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:52:18 user nova-compute[72998]:   <serial>c1137064-130c-4c2f-882b-d67352dae32d</serial>
Aug 17 08:52:18 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:52:18 user nova-compute[72998]: </disk>
Aug 17 08:52:18 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692262339.3137116, 63dba48d-6fa5-4c97-bb9a-41845041c7df => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63dba48d-6fa5-4c97-bb9a-41845041c7df {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:52:19 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully detached device vdb from instance 63dba48d-6fa5-4c97-bb9a-41845041c7df from the live domain config.
Aug 17 08:52:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusSZqlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:52:19 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf51e2a3-0658-414b-8bfb-6a07332c6a8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[acee79ff-a19e-4fe3-95b1-e6acd2e761bd]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d (non-flash)
Aug 17 08:52:19 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d (non-flash)
Aug 17 08:52:19 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4882691b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[369f1ace-bdd0-4ae0-839b-87ee1efba06d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a243880-0631-4e1a-8fda-c2f7473cea33]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[af55c095-b409-44f1-8bb2-045172d83d0f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fd6ab2-aa9c-4d2f-abd4-2e14bf3940b1]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[99021fd8-852b-4c41-9371-2b04adb6175b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f403ed6-c21d-4583-94d5-4b2ee8c182c4]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d, portal: 172.16.0.220,3260]
Aug 17 08:52:19 user nova-compute[72998]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d, portal: 172.16.0.220,3260] successful.
Aug 17 08:52:19 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1137064-130c-4c2f-882b-d67352dae32d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[145bce2b-a799-4671-a308-caecc650e6f7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] <== disconnect_volume: return (292ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:52:19 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:52:20 user nova-compute[72998]: DEBUG nova.objects.instance [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'flavor' on Instance uuid 63dba48d-6fa5-4c97-bb9a-41845041c7df {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:52:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-af675f35-f105-44a5-9016-ece6739ff992 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:52:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:52:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:52:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:52:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:52:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 63dba48d-6fa5-4c97-bb9a-41845041c7df {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:52:22 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updating instance_info_cache with network_info: [{"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:52:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-63dba48d-6fa5-4c97-bb9a-41845041c7df" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:52:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:52:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:52:33 user nova-compute[72998]: INFO nova.compute.claims [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Claim successful on node user
Aug 17 08:52:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:52:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:52:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG nova.policy [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c4bba5f3cdf4e9a90d0d70152a84a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776bff487ad04c93a39dacfc3792c23d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:52:34 user nova-compute[72998]: INFO nova.virt.block_device [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Booting with volume 37e3f6f6-d105-4e53-a563-f1cf844e0c9b at /dev/vda
Aug 17 08:52:34 user nova-compute[72998]: DEBUG os_brick.utils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff53226-63d4-4632-a17b-21ff45262029]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a447f4f-8b3a-4da3-b77d-0be10d37e178]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7414b158-dbff-4afa-8fe2-e4da1d1f2a92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2ef519-456f-4b71-8ddd-ac601010a893]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:52:34 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:52:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fad0321-ad3b-4d22-87b4-352967e1593c]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG os_brick.utils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating existing volume attachment record: f209e55a-906a-4f4b-b1e7-28618c02b539 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:52:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Successfully created port: 8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Successfully updated port: 8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-9567c864-11ae-46b8-a6c8-70a3fa65285f req-5f57ad75-5225-42a0-82f6-6a3bbcc8ed31 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-9567c864-11ae-46b8-a6c8-70a3fa65285f req-5f57ad75-5225-42a0-82f6-6a3bbcc8ed31 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing instance network info cache due to event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9567c864-11ae-46b8-a6c8-70a3fa65285f req-5f57ad75-5225-42a0-82f6-6a3bbcc8ed31 service nova] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:52:35 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.network.neutron [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Instance network_info: |[{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9567c864-11ae-46b8-a6c8-70a3fa65285f req-5f57ad75-5225-42a0-82f6-6a3bbcc8ed31 service nova] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.network.neutron [req-9567c864-11ae-46b8-a6c8-70a3fa65285f req-5f57ad75-5225-42a0-82f6-6a3bbcc8ed31 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:36 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:52:36 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=24.09148406982422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 63dba48d-6fa5-4c97-bb9a-41845041c7df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c987b47a-7a27-48d8-af54-00f2df28e791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.network.neutron [req-9567c864-11ae-46b8-a6c8-70a3fa65285f req-5f57ad75-5225-42a0-82f6-6a3bbcc8ed31 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updated VIF entry in instance network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG nova.network.neutron [req-9567c864-11ae-46b8-a6c8-70a3fa65285f req-5f57ad75-5225-42a0-82f6-6a3bbcc8ed31 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:52:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9567c864-11ae-46b8-a6c8-70a3fa65285f req-5f57ad75-5225-42a0-82f6-6a3bbcc8ed31 service nova] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:52:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:52:38 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:40 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:52:44 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Creating image(s)
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Ensure instance console log exists: /opt/stack/data/nova/instances/c987b47a-7a27-48d8-af54-00f2df28e791/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Start _get_guest_xml network_info=[{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f209e55a-906a-4f4b-b1e7-28618c02b539', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVtiGWyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c987b47a-7a27-48d8-af54-00f2df28e791', 'attached_at': '', 'detached_at': '', 'volume_id': '37e3f6f6-d105-4e53-a563-f1cf844e0c9b', 'serial': '37e3f6f6-d105-4e53-a563-f1cf844e0c9b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:52:44 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:52:44 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVtiGWyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:52:44 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:52:44 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:52:44 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6348d2f3-955e-45f8-9a9f-77f6a56bba40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:52:44 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b2eac1-d19f-46eb-affe-283e034cce7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b] added
Aug 17 08:52:44 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[833090ba-d3fe-40ab-8eae-58035d08e8e5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[389d204f-756b-473d-b3c4-84cbcc9f3c80]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qVtiGWyu {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qVtiGWyu" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[95efb188-368a-4c57-93ff-296beccfa802]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qVtiGWyu'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cdac19-844e-4029-8dfa-5a256c3568c5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40b5498-a876-463b-92d6-1db9a2e64d21]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:52:44 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:52:44 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:52:44 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:52:44 user nova-compute[72998]: 
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f7e0af-63d7-4b46-bd8a-a48997cbc036]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260]
Aug 17 08:52:44 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260] successful.
Aug 17 08:52:44 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f413ba-0aeb-44a5-949f-78b2bc9eee81]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb09a328-5730-4689-bef1-cfd99db11082]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:52:44 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:52:44 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b53361-8247-43a7-996a-94b86341409b]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:52:44 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVtiGWyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23166373733356134', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166373733356134', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-664239747',display_name='tempest-TestShelveInstance-server-664239747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-664239747',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQYj6FkGGatZqn06sBiQ9Njxrmu9SR3SKvltA/9HXZSlRQfrkHYXqv+z22JysW/R8oYjVb6fu8/VXk34I2+LhGcnchFc85jYSJpew+61NGka9TSC2RYfGui7mn6j3xDvQ==',key_name='tempest-TestShelveInstance-1614759485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='776bff487ad04c93a39dacfc3792c23d',ramdisk_id='',reservation_id='r-fzjfzl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1410150597',owner_user_name='tempest-TestShelveInstance-1410150597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:52:34Z,user_data=None,user_id='2c4bba5f3cdf4e9a90d0d70152a84a62',uuid=c987b47a-7a27-48d8-af54-00f2df28e791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converting VIF {"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lazy-loading 'pci_devices' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:52:45 user nova-compute[72998]:   <uuid>c987b47a-7a27-48d8-af54-00f2df28e791</uuid>
Aug 17 08:52:45 user nova-compute[72998]:   <name>instance-0000002c</name>
Aug 17 08:52:45 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:52:45 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:52:45 user nova-compute[72998]:   <metadata>
Aug 17 08:52:45 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:52:45 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:52:45 user nova-compute[72998]:       <nova:name>tempest-TestShelveInstance-server-664239747</nova:name>
Aug 17 08:52:45 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:52:44</nova:creationTime>
Aug 17 08:52:45 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:52:45 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:52:45 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:52:45 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:52:45 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:52:45 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:52:45 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:52:45 user nova-compute[72998]:       <nova:owner>
Aug 17 08:52:45 user nova-compute[72998]:         <nova:user uuid="2c4bba5f3cdf4e9a90d0d70152a84a62">tempest-TestShelveInstance-1410150597-project-member</nova:user>
Aug 17 08:52:45 user nova-compute[72998]:         <nova:project uuid="776bff487ad04c93a39dacfc3792c23d">tempest-TestShelveInstance-1410150597</nova:project>
Aug 17 08:52:45 user nova-compute[72998]:       </nova:owner>
Aug 17 08:52:45 user nova-compute[72998]:       <nova:ports>
Aug 17 08:52:45 user nova-compute[72998]:         <nova:port uuid="8e59b4ee-23ce-4493-b08c-375e65f40354">
Aug 17 08:52:45 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 08:52:45 user nova-compute[72998]:         </nova:port>
Aug 17 08:52:45 user nova-compute[72998]:       </nova:ports>
Aug 17 08:52:45 user nova-compute[72998]:     </nova:instance>
Aug 17 08:52:45 user nova-compute[72998]:   </metadata>
Aug 17 08:52:45 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:52:45 user nova-compute[72998]:     <system>
Aug 17 08:52:45 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:52:45 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:52:45 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:52:45 user nova-compute[72998]:       <entry name="serial">c987b47a-7a27-48d8-af54-00f2df28e791</entry>
Aug 17 08:52:45 user nova-compute[72998]:       <entry name="uuid">c987b47a-7a27-48d8-af54-00f2df28e791</entry>
Aug 17 08:52:45 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:52:45 user nova-compute[72998]:     </system>
Aug 17 08:52:45 user nova-compute[72998]:   </sysinfo>
Aug 17 08:52:45 user nova-compute[72998]:   <os>
Aug 17 08:52:45 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:52:45 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:52:45 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:52:45 user nova-compute[72998]:   </os>
Aug 17 08:52:45 user nova-compute[72998]:   <features>
Aug 17 08:52:45 user nova-compute[72998]:     <acpi/>
Aug 17 08:52:45 user nova-compute[72998]:     <apic/>
Aug 17 08:52:45 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:52:45 user nova-compute[72998]:   </features>
Aug 17 08:52:45 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:52:45 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:52:45 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:52:45 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:52:45 user nova-compute[72998]:   </clock>
Aug 17 08:52:45 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:52:45 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:52:45 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:52:45 user nova-compute[72998]:   </cpu>
Aug 17 08:52:45 user nova-compute[72998]:   <devices>
Aug 17 08:52:45 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:52:45 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:52:45 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 08:52:45 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:52:45 user nova-compute[72998]:       <serial>37e3f6f6-d105-4e53-a563-f1cf844e0c9b</serial>
Aug 17 08:52:45 user nova-compute[72998]:     </disk>
Aug 17 08:52:45 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:52:45 user nova-compute[72998]:       <mac address="fa:16:3e:28:b3:78"/>
Aug 17 08:52:45 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:52:45 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:52:45 user nova-compute[72998]:       <target dev="tap8e59b4ee-23"/>
Aug 17 08:52:45 user nova-compute[72998]:     </interface>
Aug 17 08:52:45 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:52:45 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/c987b47a-7a27-48d8-af54-00f2df28e791/console.log" append="off"/>
Aug 17 08:52:45 user nova-compute[72998]:     </serial>
Aug 17 08:52:45 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:52:45 user nova-compute[72998]:     <video>
Aug 17 08:52:45 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:52:45 user nova-compute[72998]:     </video>
Aug 17 08:52:45 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:52:45 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:52:45 user nova-compute[72998]:     </rng>
Aug 17 08:52:45 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:52:45 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:52:45 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:52:45 user nova-compute[72998]:     </memballoon>
Aug 17 08:52:45 user nova-compute[72998]:   </devices>
Aug 17 08:52:45 user nova-compute[72998]: </domain>
Aug 17 08:52:45 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-664239747',display_name='tempest-TestShelveInstance-server-664239747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-664239747',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQYj6FkGGatZqn06sBiQ9Njxrmu9SR3SKvltA/9HXZSlRQfrkHYXqv+z22JysW/R8oYjVb6fu8/VXk34I2+LhGcnchFc85jYSJpew+61NGka9TSC2RYfGui7mn6j3xDvQ==',key_name='tempest-TestShelveInstance-1614759485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='776bff487ad04c93a39dacfc3792c23d',ramdisk_id='',reservation_id='r-fzjfzl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1410150597',owner_user_name='tempest-TestShelveInstance-1410150597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:52:34Z,user_data=None,user_id='2c4bba5f3cdf4e9a90d0d70152a84a62',uuid=c987b47a-7a27-48d8-af54-00f2df28e791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converting VIF {"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG os_vif [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e59b4ee-23, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e59b4ee-23, col_values=(('external_ids', {'iface-id': '8e59b4ee-23ce-4493-b08c-375e65f40354', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:b3:78', 'vm-uuid': 'c987b47a-7a27-48d8-af54-00f2df28e791'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:45 user nova-compute[72998]: INFO os_vif [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23')
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:52:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] No VIF found with MAC fa:16:3e:28:b3:78, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:52:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-a04616c4-9e96-4a25-82f0-203b30334b55 req-a5e499ac-afa1-4398-8167-be9b663e12e0 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a04616c4-9e96-4a25-82f0-203b30334b55 req-a5e499ac-afa1-4398-8167-be9b663e12e0 service nova] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a04616c4-9e96-4a25-82f0-203b30334b55 req-a5e499ac-afa1-4398-8167-be9b663e12e0 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a04616c4-9e96-4a25-82f0-203b30334b55 req-a5e499ac-afa1-4398-8167-be9b663e12e0 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-a04616c4-9e96-4a25-82f0-203b30334b55 req-a5e499ac-afa1-4398-8167-be9b663e12e0 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] No waiting events found dispatching network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:52:47 user nova-compute[72998]: WARNING nova.compute.manager [req-a04616c4-9e96-4a25-82f0-203b30334b55 req-a5e499ac-afa1-4398-8167-be9b663e12e0 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received unexpected event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 for instance with vm_state building and task_state spawning.
Aug 17 08:52:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262369.1734838, c987b47a-7a27-48d8-af54-00f2df28e791 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:52:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] VM Resumed (Lifecycle Event)
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:52:49 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Instance spawned successfully.
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:52:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262369.1782222, c987b47a-7a27-48d8-af54-00f2df28e791 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:52:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] VM Started (Lifecycle Event)
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:52:49 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:52:49 user nova-compute[72998]: INFO nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Took 4.92 seconds to spawn the instance on the hypervisor.
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-ad4af5b7-6a7c-4e4f-84b4-df769623642c req-22798a1f-b4bf-490d-a51e-5a03a9c4ec24 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ad4af5b7-6a7c-4e4f-84b4-df769623642c req-22798a1f-b4bf-490d-a51e-5a03a9c4ec24 service nova] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ad4af5b7-6a7c-4e4f-84b4-df769623642c req-22798a1f-b4bf-490d-a51e-5a03a9c4ec24 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ad4af5b7-6a7c-4e4f-84b4-df769623642c req-22798a1f-b4bf-490d-a51e-5a03a9c4ec24 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-ad4af5b7-6a7c-4e4f-84b4-df769623642c req-22798a1f-b4bf-490d-a51e-5a03a9c4ec24 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] No waiting events found dispatching network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:52:49 user nova-compute[72998]: WARNING nova.compute.manager [req-ad4af5b7-6a7c-4e4f-84b4-df769623642c req-22798a1f-b4bf-490d-a51e-5a03a9c4ec24 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received unexpected event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 for instance with vm_state building and task_state spawning.
Aug 17 08:52:49 user nova-compute[72998]: INFO nova.compute.manager [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Took 15.66 seconds to build instance.
Aug 17 08:52:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6e00ff66-0631-4238-837d-03b4112e3b0d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.755s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:52:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:50 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:52:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:52:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:53:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:53:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:53:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:53:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:53:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:53:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:53:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:53:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:53:09 user nova-compute[72998]: INFO nova.compute.manager [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Terminating instance
Aug 17 08:53:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-3bd35ad7-5535-4e46-b330-dea824d6e579 req-7aa8f291-8659-4ce1-925a-e842f7819807 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received event network-vif-unplugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3bd35ad7-5535-4e46-b330-dea824d6e579 req-7aa8f291-8659-4ce1-925a-e842f7819807 service nova] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3bd35ad7-5535-4e46-b330-dea824d6e579 req-7aa8f291-8659-4ce1-925a-e842f7819807 service nova] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3bd35ad7-5535-4e46-b330-dea824d6e579 req-7aa8f291-8659-4ce1-925a-e842f7819807 service nova] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-3bd35ad7-5535-4e46-b330-dea824d6e579 req-7aa8f291-8659-4ce1-925a-e842f7819807 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] No waiting events found dispatching network-vif-unplugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-3bd35ad7-5535-4e46-b330-dea824d6e579 req-7aa8f291-8659-4ce1-925a-e842f7819807 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received event network-vif-unplugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:53:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Instance destroyed successfully.
Aug 17 08:53:09 user nova-compute[72998]: DEBUG nova.objects.instance [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lazy-loading 'resources' on Instance uuid 63dba48d-6fa5-4c97-bb9a-41845041c7df {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:50:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-932613884',display_name='tempest-AttachVolumeNegativeTest-server-932613884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-932613884',id=43,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGJ0NsqKVt7KSJSckTpcCT+wHbu9vJHkV6TJ6HVciQ0FZQ+veTWE8+p0b+4Nv4XwxlxFUmNzr6Wil/1vSKsRLDYz8kp5FUvRcnfBYmm6ZSizyBgGbhxBfeSs8463qM/MQ==',key_name='tempest-keypair-1713961864',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91f2b81f590b4c05bde54a7669412ac3',ramdisk_id='',reservation_id='r-z0ilo8wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1248035146',owner_user_name='tempest-AttachVolumeNegativeTest-1248035146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6fa0f0675942b18c911f61e39bf71d',uuid=63dba48d-6fa5-4c97-bb9a-41845041c7df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converting VIF {"id": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "address": "fa:16:3e:5b:3f:f4", "network": {"id": "0b86248e-23b3-4cba-a30d-945c25fbdd45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-834979889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91f2b81f590b4c05bde54a7669412ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3fd1153-ff", "ovs_interfaceid": "a3fd1153-ffe4-4c12-a303-031a6ff052e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:3f:f4,bridge_name='br-int',has_traffic_filtering=True,id=a3fd1153-ffe4-4c12-a303-031a6ff052e4,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fd1153-ff') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG os_vif [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:3f:f4,bridge_name='br-int',has_traffic_filtering=True,id=a3fd1153-ffe4-4c12-a303-031a6ff052e4,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fd1153-ff') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3fd1153-ff, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:53:09 user nova-compute[72998]: INFO os_vif [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:3f:f4,bridge_name='br-int',has_traffic_filtering=True,id=a3fd1153-ffe4-4c12-a303-031a6ff052e4,network=Network(0b86248e-23b3-4cba-a30d-945c25fbdd45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3fd1153-ff')
Aug 17 08:53:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Deleting instance files /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df_del
Aug 17 08:53:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Deletion of /opt/stack/data/nova/instances/63dba48d-6fa5-4c97-bb9a-41845041c7df_del complete
Aug 17 08:53:09 user nova-compute[72998]: INFO nova.compute.manager [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 08:53:10 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:53:10 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:53:10 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:53:10 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:53:10 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Took 0.70 seconds to deallocate network for instance.
Aug 17 08:53:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-f56c1995-8298-49aa-9263-4ca920ec54ca req-d23dfe05-53ab-4e2e-ae1f-55a9868b08d8 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received event network-vif-deleted-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:53:10 user nova-compute[72998]: INFO nova.compute.manager [req-f56c1995-8298-49aa-9263-4ca920ec54ca req-d23dfe05-53ab-4e2e-ae1f-55a9868b08d8 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Neutron deleted interface a3fd1153-ffe4-4c12-a303-031a6ff052e4; detaching it from the instance and deleting it from the info cache
Aug 17 08:53:10 user nova-compute[72998]: DEBUG nova.network.neutron [req-f56c1995-8298-49aa-9263-4ca920ec54ca req-d23dfe05-53ab-4e2e-ae1f-55a9868b08d8 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:53:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-f56c1995-8298-49aa-9263-4ca920ec54ca req-d23dfe05-53ab-4e2e-ae1f-55a9868b08d8 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Detach interface failed, port_id=a3fd1153-ffe4-4c12-a303-031a6ff052e4, reason: Instance 63dba48d-6fa5-4c97-bb9a-41845041c7df could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:53:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:53:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:53:10 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:53:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:53:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:53:10 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Deleted allocations for instance 63dba48d-6fa5-4c97-bb9a-41845041c7df
Aug 17 08:53:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dfb4ede9-9da5-4267-875d-ea7889c54532 tempest-AttachVolumeNegativeTest-1248035146 tempest-AttachVolumeNegativeTest-1248035146-project-member] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:53:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-e3639821-8349-4615-9590-592a0c6ab938 req-2555c4de-ecba-4021-ba3c-d59659856c89 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received event network-vif-plugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:53:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e3639821-8349-4615-9590-592a0c6ab938 req-2555c4de-ecba-4021-ba3c-d59659856c89 service nova] Acquiring lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:53:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e3639821-8349-4615-9590-592a0c6ab938 req-2555c4de-ecba-4021-ba3c-d59659856c89 service nova] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:53:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e3639821-8349-4615-9590-592a0c6ab938 req-2555c4de-ecba-4021-ba3c-d59659856c89 service nova] Lock "63dba48d-6fa5-4c97-bb9a-41845041c7df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:53:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-e3639821-8349-4615-9590-592a0c6ab938 req-2555c4de-ecba-4021-ba3c-d59659856c89 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] No waiting events found dispatching network-vif-plugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:53:11 user nova-compute[72998]: WARNING nova.compute.manager [req-e3639821-8349-4615-9590-592a0c6ab938 req-2555c4de-ecba-4021-ba3c-d59659856c89 service nova] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Received unexpected event network-vif-plugged-a3fd1153-ffe4-4c12-a303-031a6ff052e4 for instance with vm_state deleted and task_state None.
Aug 17 08:53:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:53:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:53:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:53:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:53:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:53:21 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:53:21 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:53:22 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:53:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:53:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:53:24 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692262389.8959026, 63dba48d-6fa5-4c97-bb9a-41845041c7df => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:53:24 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] VM Stopped (Lifecycle Event)
Aug 17 08:53:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-8a423851-5e8b-42ea-9bb7-bd4bf4ee4a44 None None] [instance: 63dba48d-6fa5-4c97-bb9a-41845041c7df] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:53:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:53:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:53:34 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:53:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:53:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:53:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:53:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:53:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:53:35 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:53:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:53:36 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:53:36 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:53:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=24.117835998535156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:53:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:53:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:53:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c987b47a-7a27-48d8-af54-00f2df28e791 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:53:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:53:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:53:36 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:53:36 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:53:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:53:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:53:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:53:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:53:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:53:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:53:40 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:53:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:53:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:53:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:53:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:54:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:23 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:54:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:54:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:54:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:54:23 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:54:23 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:54:24 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:54:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:54:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:54:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-70f92353-7dbe-4582-ab00-da8fde9b207f req-e4a697db-0bec-4228-8645-4a75e47c946b service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:54:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-70f92353-7dbe-4582-ab00-da8fde9b207f req-e4a697db-0bec-4228-8645-4a75e47c946b service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing instance network info cache due to event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:54:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-70f92353-7dbe-4582-ab00-da8fde9b207f req-e4a697db-0bec-4228-8645-4a75e47c946b service nova] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:54:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-70f92353-7dbe-4582-ab00-da8fde9b207f req-e4a697db-0bec-4228-8645-4a75e47c946b service nova] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:54:25 user nova-compute[72998]: DEBUG nova.network.neutron [req-70f92353-7dbe-4582-ab00-da8fde9b207f req-e4a697db-0bec-4228-8645-4a75e47c946b service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:54:26 user nova-compute[72998]: INFO nova.compute.manager [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Shelve offloading
Aug 17 08:54:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-5c57bfc3-9ce2-4ee3-b134-e0e17e144123 req-31ce090b-0503-4138-96cb-e535cd57f581 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-unplugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5c57bfc3-9ce2-4ee3-b134-e0e17e144123 req-31ce090b-0503-4138-96cb-e535cd57f581 service nova] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5c57bfc3-9ce2-4ee3-b134-e0e17e144123 req-31ce090b-0503-4138-96cb-e535cd57f581 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5c57bfc3-9ce2-4ee3-b134-e0e17e144123 req-31ce090b-0503-4138-96cb-e535cd57f581 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG nova.compute.manager [req-5c57bfc3-9ce2-4ee3-b134-e0e17e144123 req-31ce090b-0503-4138-96cb-e535cd57f581 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] No waiting events found dispatching network-vif-unplugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:54:26 user nova-compute[72998]: WARNING nova.compute.manager [req-5c57bfc3-9ce2-4ee3-b134-e0e17e144123 req-31ce090b-0503-4138-96cb-e535cd57f581 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received unexpected event network-vif-unplugged-8e59b4ee-23ce-4493-b08c-375e65f40354 for instance with vm_state active and task_state shelving.
Aug 17 08:54:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-70f92353-7dbe-4582-ab00-da8fde9b207f req-e4a697db-0bec-4228-8645-4a75e47c946b service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updated VIF entry in instance network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG nova.network.neutron [req-70f92353-7dbe-4582-ab00-da8fde9b207f req-e4a697db-0bec-4228-8645-4a75e47c946b service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-70f92353-7dbe-4582-ab00-da8fde9b207f req-e4a697db-0bec-4228-8645-4a75e47c946b service nova] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:54:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Instance destroyed successfully.
Aug 17 08:54:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:54:26 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:54:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:54:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:54:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Instance destroyed successfully.
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lazy-loading 'resources' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-664239747',display_name='tempest-TestShelveInstance-server-664239747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-664239747',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQYj6FkGGatZqn06sBiQ9Njxrmu9SR3SKvltA/9HXZSlRQfrkHYXqv+z22JysW/R8oYjVb6fu8/VXk34I2+LhGcnchFc85jYSJpew+61NGka9TSC2RYfGui7mn6j3xDvQ==',key_name='tempest-TestShelveInstance-1614759485',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:52:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='776bff487ad04c93a39dacfc3792c23d',ramdisk_id='',reservation_id='r-fzjfzl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1410150597',owner_user_name='tempest-TestShelveInstance-1410150597-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:52:49Z,user_data=None,user_id='2c4bba5f3cdf4e9a90d0d70152a84a62',uuid=c987b47a-7a27-48d8-af54-00f2df28e791,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converting VIF {"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_vif [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e59b4ee-23, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:54:28 user nova-compute[72998]: INFO os_vif [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23')
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVtiGWyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:54:28 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d1f447-1ba1-4996-bca1-17c4dd0aef96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cd09ed-49a8-4c35-9de2-14ee7cde4ab6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:54:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:54:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4882681f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b514adbb-f381-4f6a-a2fa-64a2439ace1d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8c92c0-f71d-4a91-a272-bd7966e8bd11]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-33f75879-b2bc-47fb-b0d4-16a3247552c1 req-ae948c75-fbe8-433d-b29d-4977459375b7 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-33f75879-b2bc-47fb-b0d4-16a3247552c1 req-ae948c75-fbe8-433d-b29d-4977459375b7 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing instance network info cache due to event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-33f75879-b2bc-47fb-b0d4-16a3247552c1 req-ae948c75-fbe8-433d-b29d-4977459375b7 service nova] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-33f75879-b2bc-47fb-b0d4-16a3247552c1 req-ae948c75-fbe8-433d-b29d-4977459375b7 service nova] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.network.neutron [req-33f75879-b2bc-47fb-b0d4-16a3247552c1 req-ae948c75-fbe8-433d-b29d-4977459375b7 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3736b55d-4710-4e2a-a6d5-203b7760f1aa]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b530000c-d977-4789-8d8e-08d18ac45228]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[445101ce-41ae-4c12-8f17-6f3a8816dcaf]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a70f1f-7ad5-4829-853e-2d778df23a30]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260]
Aug 17 08:54:28 user nova-compute[72998]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260] successful.
Aug 17 08:54:28 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d569d63-a879-442f-8114-2a5d3999ae7f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] <== disconnect_volume: return (294ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:54:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Deleting instance files /opt/stack/data/nova/instances/c987b47a-7a27-48d8-af54-00f2df28e791_del
Aug 17 08:54:28 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Deletion of /opt/stack/data/nova/instances/c987b47a-7a27-48d8-af54-00f2df28e791_del complete
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.network.neutron [req-33f75879-b2bc-47fb-b0d4-16a3247552c1 req-ae948c75-fbe8-433d-b29d-4977459375b7 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updated VIF entry in instance network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.network.neutron [req-33f75879-b2bc-47fb-b0d4-16a3247552c1 req-ae948c75-fbe8-433d-b29d-4977459375b7 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": null, "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-33f75879-b2bc-47fb-b0d4-16a3247552c1 req-ae948c75-fbe8-433d-b29d-4977459375b7 service nova] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-aa754c14-dd8c-4eb3-9957-0be75c2f2ae1 req-837a52fe-1612-42cb-b0be-d5ec0c411b25 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-aa754c14-dd8c-4eb3-9957-0be75c2f2ae1 req-837a52fe-1612-42cb-b0be-d5ec0c411b25 service nova] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-aa754c14-dd8c-4eb3-9957-0be75c2f2ae1 req-837a52fe-1612-42cb-b0be-d5ec0c411b25 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-aa754c14-dd8c-4eb3-9957-0be75c2f2ae1 req-837a52fe-1612-42cb-b0be-d5ec0c411b25 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:54:28 user nova-compute[72998]: DEBUG nova.compute.manager [req-aa754c14-dd8c-4eb3-9957-0be75c2f2ae1 req-837a52fe-1612-42cb-b0be-d5ec0c411b25 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] No waiting events found dispatching network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:54:28 user nova-compute[72998]: WARNING nova.compute.manager [req-aa754c14-dd8c-4eb3-9957-0be75c2f2ae1 req-837a52fe-1612-42cb-b0be-d5ec0c411b25 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received unexpected event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 for instance with vm_state active and task_state shelving.
Aug 17 08:54:29 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Deleted allocations for instance c987b47a-7a27-48d8-af54-00f2df28e791
Aug 17 08:54:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:54:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:54:29 user nova-compute[72998]: DEBUG nova.objects.instance [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lazy-loading 'numa_topology' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:54:29 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:54:29 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:54:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.100s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:54:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-d02a2d59-2470-4b07-9da8-df54fa2e4fa4 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.413s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:54:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:54:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:54:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:54:35 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:54:36 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:54:36 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:54:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=24.107810974121094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:54:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:54:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:54:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:54:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:54:36 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:54:36 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:54:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:54:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:54:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:54:40 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:41 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692262466.9805381, c987b47a-7a27-48d8-af54-00f2df28e791 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:54:41 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] VM Stopped (Lifecycle Event)
Aug 17 08:54:42 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7922667e-dd4a-4f10-8447-4beb24c04bed None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:54:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:54:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:54:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:54:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:55:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:55:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:55:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 08:55:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:55:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:55:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:55:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:55:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:55:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:55:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:55:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:55:37 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:55:37 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=24.10562515258789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:55:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:55:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:55:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 08:55:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:55:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:55:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:55:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:55:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:55:52 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:55:52 user nova-compute[72998]: INFO nova.compute.claims [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Claim successful on node user
Aug 17 08:55:52 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:55:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:55:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG nova.policy [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c79e5446b1e74d4ba51b23ef1a4cdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b8010fbf8045489796ec1d9c6ffb45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:55:53 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Creating image(s)
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "/opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "/opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.166s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk 1073741824" returned: 0 in 0.047s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.169s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 08:55:53 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Cannot resize image /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.objects.instance [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lazy-loading 'migration_context' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Ensure instance console log exists: /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Successfully created port: 4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Successfully updated port: 4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquired lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-c4e19b35-8cc6-4ad0-a66c-0aa99d479408 req-c58c7a42-6a29-4616-9300-bc698f48baf6 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received event network-changed-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-c4e19b35-8cc6-4ad0-a66c-0aa99d479408 req-c58c7a42-6a29-4616-9300-bc698f48baf6 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Refreshing instance network info cache due to event network-changed-4adbb317-5bd4-486b-a26a-090fda7121aa. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c4e19b35-8cc6-4ad0-a66c-0aa99d479408 req-c58c7a42-6a29-4616-9300-bc698f48baf6 service nova] Acquiring lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:55:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.network.neutron [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updating instance_info_cache with network_info: [{"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Releasing lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Instance network_info: |[{"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c4e19b35-8cc6-4ad0-a66c-0aa99d479408 req-c58c7a42-6a29-4616-9300-bc698f48baf6 service nova] Acquired lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.network.neutron [req-c4e19b35-8cc6-4ad0-a66c-0aa99d479408 req-c58c7a42-6a29-4616-9300-bc698f48baf6 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Refreshing network info cache for port 4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Start _get_guest_xml network_info=[{"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:55:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:55:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:55:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-877129420',display_name='tempest-TestServerVolumeAttachmentScenario-server-877129420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-877129420',id=45,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIt1+mdfMHwdvlFVQBkIEyPPgTimTp/fNtZPQ2FTxGt+O4yqfeiGB642U+YhsUEzgKe0vkijKd9hRn+fIQ0w92M2yzueSmQFQcIweAJVvZ4dWNKsG+7TLIui5O+8gTfWA==',key_name='tempest-keypair-1932501436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22b8010fbf8045489796ec1d9c6ffb45',ramdisk_id='',reservation_id='r-r2g9huzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2049281515',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2049281515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c79e5446b1e74d4ba51b23ef1a4cdfcc',uuid=4fe673a6-f634-4e82-9412-d30b6a02e254,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Converting VIF {"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2d:61,bridge_name='br-int',has_traffic_filtering=True,id=4adbb317-5bd4-486b-a26a-090fda7121aa,network=Network(e057e3a8-654f-4d48-b90e-a3d97515a231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adbb317-5b') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:55:55 user nova-compute[72998]:   <uuid>4fe673a6-f634-4e82-9412-d30b6a02e254</uuid>
Aug 17 08:55:55 user nova-compute[72998]:   <name>instance-0000002d</name>
Aug 17 08:55:55 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:55:55 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:55:55 user nova-compute[72998]:   <metadata>
Aug 17 08:55:55 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:55:55 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:55:55 user nova-compute[72998]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-877129420</nova:name>
Aug 17 08:55:55 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:55:55</nova:creationTime>
Aug 17 08:55:55 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:55:55 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:55:55 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:55:55 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:55:55 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:55:55 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:55:55 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:55:55 user nova-compute[72998]:       <nova:owner>
Aug 17 08:55:55 user nova-compute[72998]:         <nova:user uuid="c79e5446b1e74d4ba51b23ef1a4cdfcc">tempest-TestServerVolumeAttachmentScenario-2049281515-project-member</nova:user>
Aug 17 08:55:55 user nova-compute[72998]:         <nova:project uuid="22b8010fbf8045489796ec1d9c6ffb45">tempest-TestServerVolumeAttachmentScenario-2049281515</nova:project>
Aug 17 08:55:55 user nova-compute[72998]:       </nova:owner>
Aug 17 08:55:55 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 08:55:55 user nova-compute[72998]:       <nova:ports>
Aug 17 08:55:55 user nova-compute[72998]:         <nova:port uuid="4adbb317-5bd4-486b-a26a-090fda7121aa">
Aug 17 08:55:55 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 08:55:55 user nova-compute[72998]:         </nova:port>
Aug 17 08:55:55 user nova-compute[72998]:       </nova:ports>
Aug 17 08:55:55 user nova-compute[72998]:     </nova:instance>
Aug 17 08:55:55 user nova-compute[72998]:   </metadata>
Aug 17 08:55:55 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:55:55 user nova-compute[72998]:     <system>
Aug 17 08:55:55 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:55:55 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:55:55 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:55:55 user nova-compute[72998]:       <entry name="serial">4fe673a6-f634-4e82-9412-d30b6a02e254</entry>
Aug 17 08:55:55 user nova-compute[72998]:       <entry name="uuid">4fe673a6-f634-4e82-9412-d30b6a02e254</entry>
Aug 17 08:55:55 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:55:55 user nova-compute[72998]:     </system>
Aug 17 08:55:55 user nova-compute[72998]:   </sysinfo>
Aug 17 08:55:55 user nova-compute[72998]:   <os>
Aug 17 08:55:55 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:55:55 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:55:55 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:55:55 user nova-compute[72998]:   </os>
Aug 17 08:55:55 user nova-compute[72998]:   <features>
Aug 17 08:55:55 user nova-compute[72998]:     <acpi/>
Aug 17 08:55:55 user nova-compute[72998]:     <apic/>
Aug 17 08:55:55 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:55:55 user nova-compute[72998]:   </features>
Aug 17 08:55:55 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:55:55 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:55:55 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:55:55 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:55:55 user nova-compute[72998]:   </clock>
Aug 17 08:55:55 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:55:55 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:55:55 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:55:55 user nova-compute[72998]:   </cpu>
Aug 17 08:55:55 user nova-compute[72998]:   <devices>
Aug 17 08:55:55 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 08:55:55 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 08:55:55 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk"/>
Aug 17 08:55:55 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:55:55 user nova-compute[72998]:     </disk>
Aug 17 08:55:55 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:55:55 user nova-compute[72998]:       <mac address="fa:16:3e:3e:2d:61"/>
Aug 17 08:55:55 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:55:55 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:55:55 user nova-compute[72998]:       <target dev="tap4adbb317-5b"/>
Aug 17 08:55:55 user nova-compute[72998]:     </interface>
Aug 17 08:55:55 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:55:55 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/console.log" append="off"/>
Aug 17 08:55:55 user nova-compute[72998]:     </serial>
Aug 17 08:55:55 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:55:55 user nova-compute[72998]:     <video>
Aug 17 08:55:55 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:55:55 user nova-compute[72998]:     </video>
Aug 17 08:55:55 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:55:55 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:55:55 user nova-compute[72998]:     </rng>
Aug 17 08:55:55 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:55:55 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:55:55 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:55:55 user nova-compute[72998]:     </memballoon>
Aug 17 08:55:55 user nova-compute[72998]:   </devices>
Aug 17 08:55:55 user nova-compute[72998]: </domain>
Aug 17 08:55:55 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:55:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-877129420',display_name='tempest-TestServerVolumeAttachmentScenario-server-877129420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-877129420',id=45,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIt1+mdfMHwdvlFVQBkIEyPPgTimTp/fNtZPQ2FTxGt+O4yqfeiGB642U+YhsUEzgKe0vkijKd9hRn+fIQ0w92M2yzueSmQFQcIweAJVvZ4dWNKsG+7TLIui5O+8gTfWA==',key_name='tempest-keypair-1932501436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22b8010fbf8045489796ec1d9c6ffb45',ramdisk_id='',reservation_id='r-r2g9huzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2049281515',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2049281515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c79e5446b1e74d4ba51b23ef1a4cdfcc',uuid=4fe673a6-f634-4e82-9412-d30b6a02e254,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Converting VIF {"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2d:61,bridge_name='br-int',has_traffic_filtering=True,id=4adbb317-5bd4-486b-a26a-090fda7121aa,network=Network(e057e3a8-654f-4d48-b90e-a3d97515a231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adbb317-5b') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG os_vif [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2d:61,bridge_name='br-int',has_traffic_filtering=True,id=4adbb317-5bd4-486b-a26a-090fda7121aa,network=Network(e057e3a8-654f-4d48-b90e-a3d97515a231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adbb317-5b') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4adbb317-5b, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4adbb317-5b, col_values=(('external_ids', {'iface-id': '4adbb317-5bd4-486b-a26a-090fda7121aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:2d:61', 'vm-uuid': '4fe673a6-f634-4e82-9412-d30b6a02e254'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:55 user nova-compute[72998]: INFO os_vif [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2d:61,bridge_name='br-int',has_traffic_filtering=True,id=4adbb317-5bd4-486b-a26a-090fda7121aa,network=Network(e057e3a8-654f-4d48-b90e-a3d97515a231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adbb317-5b')
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] No VIF found with MAC fa:16:3e:3e:2d:61, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.network.neutron [req-c4e19b35-8cc6-4ad0-a66c-0aa99d479408 req-c58c7a42-6a29-4616-9300-bc698f48baf6 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updated VIF entry in instance network info cache for port 4adbb317-5bd4-486b-a26a-090fda7121aa. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG nova.network.neutron [req-c4e19b35-8cc6-4ad0-a66c-0aa99d479408 req-c58c7a42-6a29-4616-9300-bc698f48baf6 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updating instance_info_cache with network_info: [{"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:55:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c4e19b35-8cc6-4ad0-a66c-0aa99d479408 req-c58c7a42-6a29-4616-9300-bc698f48baf6 service nova] Releasing lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:55:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-60f74943-d894-4281-9795-2488548c5c5e req-5acd9a20-c363-496b-915b-b5105dab1a55 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received event network-vif-plugged-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:55:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-60f74943-d894-4281-9795-2488548c5c5e req-5acd9a20-c363-496b-915b-b5105dab1a55 service nova] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:55:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-60f74943-d894-4281-9795-2488548c5c5e req-5acd9a20-c363-496b-915b-b5105dab1a55 service nova] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:55:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-60f74943-d894-4281-9795-2488548c5c5e req-5acd9a20-c363-496b-915b-b5105dab1a55 service nova] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:55:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-60f74943-d894-4281-9795-2488548c5c5e req-5acd9a20-c363-496b-915b-b5105dab1a55 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] No waiting events found dispatching network-vif-plugged-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:55:56 user nova-compute[72998]: WARNING nova.compute.manager [req-60f74943-d894-4281-9795-2488548c5c5e req-5acd9a20-c363-496b-915b-b5105dab1a55 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received unexpected event network-vif-plugged-4adbb317-5bd4-486b-a26a-090fda7121aa for instance with vm_state building and task_state spawning.
Aug 17 08:55:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262558.7499123, 4fe673a6-f634-4e82-9412-d30b6a02e254 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:55:58 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] VM Resumed (Lifecycle Event)
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:55:58 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Instance spawned successfully.
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 08:55:58 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262558.7511547, 4fe673a6-f634-4e82-9412-d30b6a02e254 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:55:58 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] VM Started (Lifecycle Event)
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:55:58 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:55:58 user nova-compute[72998]: INFO nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 17 08:55:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:55:58 user nova-compute[72998]: INFO nova.compute.manager [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Took 6.10 seconds to build instance.
Aug 17 08:55:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-eb0d6783-1717-4a6d-8bef-17be5e84c40c tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.195s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:55:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-68a0c99a-3c76-4107-bb00-fa2a3f9112d4 req-b604a8c3-83af-4a56-9ff6-1b30c4e312a4 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received event network-vif-plugged-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:55:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-68a0c99a-3c76-4107-bb00-fa2a3f9112d4 req-b604a8c3-83af-4a56-9ff6-1b30c4e312a4 service nova] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:55:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-68a0c99a-3c76-4107-bb00-fa2a3f9112d4 req-b604a8c3-83af-4a56-9ff6-1b30c4e312a4 service nova] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:55:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-68a0c99a-3c76-4107-bb00-fa2a3f9112d4 req-b604a8c3-83af-4a56-9ff6-1b30c4e312a4 service nova] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:55:59 user nova-compute[72998]: DEBUG nova.compute.manager [req-68a0c99a-3c76-4107-bb00-fa2a3f9112d4 req-b604a8c3-83af-4a56-9ff6-1b30c4e312a4 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] No waiting events found dispatching network-vif-plugged-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:55:59 user nova-compute[72998]: WARNING nova.compute.manager [req-68a0c99a-3c76-4107-bb00-fa2a3f9112d4 req-b604a8c3-83af-4a56-9ff6-1b30c4e312a4 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received unexpected event network-vif-plugged-4adbb317-5bd4-486b-a26a-090fda7121aa for instance with vm_state active and task_state None.
Aug 17 08:56:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:56:17 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:56:17 user nova-compute[72998]: INFO nova.compute.manager [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Unshelving
Aug 17 08:56:17 user nova-compute[72998]: INFO nova.virt.block_device [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Booting with volume 37e3f6f6-d105-4e53-a563-f1cf844e0c9b at /dev/vda
Aug 17 08:56:18 user nova-compute[72998]: DEBUG os_brick.utils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c818c-81aa-4158-8650-d57fcb8aafaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1261e594-b36f-4120-ba4b-589bb98d5cfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae859a12-6bb3-461b-bbfa-10a5ef2588c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a686b9fd-0458-458a-874d-554077c7143b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:56:18 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:56:18 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ebbfd9-ba08-4f25-8127-0299cf1a1073]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG os_brick.utils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:56:18 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating existing volume attachment record: e75007fc-f140-437e-9bda-a60826e51524 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:56:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:56:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:56:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:56:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:56:24 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:56:24 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:56:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updating instance_info_cache with network_info: [{"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:56:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:56:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:56:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:56:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:56:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lazy-loading 'pci_requests' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:56:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lazy-loading 'numa_topology' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:56:28 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:56:28 user nova-compute[72998]: INFO nova.compute.claims [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Claim successful on node user
Aug 17 08:56:28 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:56:28 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:56:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:56:28 user nova-compute[72998]: INFO nova.network.neutron [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating port 8e59b4ee-23ce-4493-b08c-375e65f40354 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-03b8e100-1a07-4e27-b1ff-d1c77ffaa69f req-f664d65d-4e85-4fc8-90de-085ca9e8ef97 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-03b8e100-1a07-4e27-b1ff-d1c77ffaa69f req-f664d65d-4e85-4fc8-90de-085ca9e8ef97 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing instance network info cache due to event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-03b8e100-1a07-4e27-b1ff-d1c77ffaa69f req-f664d65d-4e85-4fc8-90de-085ca9e8ef97 service nova] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:56:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Creating image(s)
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Ensure instance console log exists: /opt/stack/data/nova/instances/c987b47a-7a27-48d8-af54-00f2df28e791/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Start _get_guest_xml network_info=[{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e75007fc-f140-437e-9bda-a60826e51524', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVtiGWyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c987b47a-7a27-48d8-af54-00f2df28e791', 'attached_at': '', 'detached_at': '', 'volume_id': '37e3f6f6-d105-4e53-a563-f1cf844e0c9b', 'serial': '37e3f6f6-d105-4e53-a563-f1cf844e0c9b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-03b8e100-1a07-4e27-b1ff-d1c77ffaa69f req-f664d65d-4e85-4fc8-90de-085ca9e8ef97 service nova] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.network.neutron [req-03b8e100-1a07-4e27-b1ff-d1c77ffaa69f req-f664d65d-4e85-4fc8-90de-085ca9e8ef97 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:56:29 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:56:29 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lazy-loading 'vcpu_model' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVtiGWyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:56:29 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:56:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:56:29 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:56:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:56:29 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb2536f-f3c6-4369-af7e-1ce294511884]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:56:29 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86d0492-4a8e-49c9-b653-630d3a094cc0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b] added
Aug 17 08:56:29 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:56:29 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c04768-ba18-44c9-945a-bc00a73f6790]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[310021a7-c952-4f08-af66-dce343df2e41]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qVtiGWyu {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qVtiGWyu" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1ca20b-4f25-4805-87f7-12d81fce3340]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qVtiGWyu'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cd64b5-6d5c-4ca0-8f38-620c1d3df5f0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[922955b7-ade1-4092-8e99-176035544df4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:56:30 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:56:30 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:56:30 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:56:30 user nova-compute[72998]: 
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c29a4a0-49f1-44d5-824c-b8d0cff8ac96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260]
Aug 17 08:56:30 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260] successful.
Aug 17 08:56:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c0d919-f0b6-4b45-aa07-dbf0fdfef90a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4342dbe9-2de7-42d3-a777-c075ea49300e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:56:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:56:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[835f0c87-0d4c-46a1-8b23-a58d3e026292]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVtiGWyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG nova.network.neutron [req-03b8e100-1a07-4e27-b1ff-d1c77ffaa69f req-f664d65d-4e85-4fc8-90de-085ca9e8ef97 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updated VIF entry in instance network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG nova.network.neutron [req-03b8e100-1a07-4e27-b1ff-d1c77ffaa69f req-f664d65d-4e85-4fc8-90de-085ca9e8ef97 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-03b8e100-1a07-4e27-b1ff-d1c77ffaa69f req-f664d65d-4e85-4fc8-90de-085ca9e8ef97 service nova] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:56:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23166373733356134', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166373733356134', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-664239747',display_name='tempest-TestShelveInstance-server-664239747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-664239747',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1614759485',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:52:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='776bff487ad04c93a39dacfc3792c23d',ramdisk_id='',reservation_id='r-fzjfzl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1410150597',owner_user_name='tempest-TestShelveInstance-1410150597-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:56:18Z,user_data=None,user_id='2c4bba5f3cdf4e9a90d0d70152a84a62',uuid=c987b47a-7a27-48d8-af54-00f2df28e791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converting VIF {"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lazy-loading 'pci_devices' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:56:31 user nova-compute[72998]:   <uuid>c987b47a-7a27-48d8-af54-00f2df28e791</uuid>
Aug 17 08:56:31 user nova-compute[72998]:   <name>instance-0000002c</name>
Aug 17 08:56:31 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:56:31 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:56:31 user nova-compute[72998]:   <metadata>
Aug 17 08:56:31 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:56:31 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:56:31 user nova-compute[72998]:       <nova:name>tempest-TestShelveInstance-server-664239747</nova:name>
Aug 17 08:56:31 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:56:29</nova:creationTime>
Aug 17 08:56:31 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:56:31 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:56:31 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:56:31 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:56:31 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:56:31 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:56:31 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:56:31 user nova-compute[72998]:       <nova:owner>
Aug 17 08:56:31 user nova-compute[72998]:         <nova:user uuid="2c4bba5f3cdf4e9a90d0d70152a84a62">tempest-TestShelveInstance-1410150597-project-member</nova:user>
Aug 17 08:56:31 user nova-compute[72998]:         <nova:project uuid="776bff487ad04c93a39dacfc3792c23d">tempest-TestShelveInstance-1410150597</nova:project>
Aug 17 08:56:31 user nova-compute[72998]:       </nova:owner>
Aug 17 08:56:31 user nova-compute[72998]:       <nova:ports>
Aug 17 08:56:31 user nova-compute[72998]:         <nova:port uuid="8e59b4ee-23ce-4493-b08c-375e65f40354">
Aug 17 08:56:31 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 08:56:31 user nova-compute[72998]:         </nova:port>
Aug 17 08:56:31 user nova-compute[72998]:       </nova:ports>
Aug 17 08:56:31 user nova-compute[72998]:     </nova:instance>
Aug 17 08:56:31 user nova-compute[72998]:   </metadata>
Aug 17 08:56:31 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:56:31 user nova-compute[72998]:     <system>
Aug 17 08:56:31 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:56:31 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:56:31 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:56:31 user nova-compute[72998]:       <entry name="serial">c987b47a-7a27-48d8-af54-00f2df28e791</entry>
Aug 17 08:56:31 user nova-compute[72998]:       <entry name="uuid">c987b47a-7a27-48d8-af54-00f2df28e791</entry>
Aug 17 08:56:31 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:56:31 user nova-compute[72998]:     </system>
Aug 17 08:56:31 user nova-compute[72998]:   </sysinfo>
Aug 17 08:56:31 user nova-compute[72998]:   <os>
Aug 17 08:56:31 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:56:31 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:56:31 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:56:31 user nova-compute[72998]:   </os>
Aug 17 08:56:31 user nova-compute[72998]:   <features>
Aug 17 08:56:31 user nova-compute[72998]:     <acpi/>
Aug 17 08:56:31 user nova-compute[72998]:     <apic/>
Aug 17 08:56:31 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:56:31 user nova-compute[72998]:   </features>
Aug 17 08:56:31 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:56:31 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:56:31 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:56:31 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:56:31 user nova-compute[72998]:   </clock>
Aug 17 08:56:31 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:56:31 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:56:31 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:56:31 user nova-compute[72998]:   </cpu>
Aug 17 08:56:31 user nova-compute[72998]:   <devices>
Aug 17 08:56:31 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:56:31 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:56:31 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 08:56:31 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:56:31 user nova-compute[72998]:       <serial>37e3f6f6-d105-4e53-a563-f1cf844e0c9b</serial>
Aug 17 08:56:31 user nova-compute[72998]:     </disk>
Aug 17 08:56:31 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:56:31 user nova-compute[72998]:       <mac address="fa:16:3e:28:b3:78"/>
Aug 17 08:56:31 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:56:31 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:56:31 user nova-compute[72998]:       <target dev="tap8e59b4ee-23"/>
Aug 17 08:56:31 user nova-compute[72998]:     </interface>
Aug 17 08:56:31 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:56:31 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/c987b47a-7a27-48d8-af54-00f2df28e791/console.log" append="off"/>
Aug 17 08:56:31 user nova-compute[72998]:     </serial>
Aug 17 08:56:31 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:56:31 user nova-compute[72998]:     <video>
Aug 17 08:56:31 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:56:31 user nova-compute[72998]:     </video>
Aug 17 08:56:31 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:56:31 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:56:31 user nova-compute[72998]:     </rng>
Aug 17 08:56:31 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:56:31 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:56:31 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:56:31 user nova-compute[72998]:     </memballoon>
Aug 17 08:56:31 user nova-compute[72998]:   </devices>
Aug 17 08:56:31 user nova-compute[72998]: </domain>
Aug 17 08:56:31 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-664239747',display_name='tempest-TestShelveInstance-server-664239747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-664239747',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1614759485',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:52:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='776bff487ad04c93a39dacfc3792c23d',ramdisk_id='',reservation_id='r-fzjfzl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1410150597',owner_user_name='tempest-TestShelveInstance-1410150597-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:56:18Z,user_data=None,user_id='2c4bba5f3cdf4e9a90d0d70152a84a62',uuid=c987b47a-7a27-48d8-af54-00f2df28e791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converting VIF {"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG os_vif [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e59b4ee-23, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e59b4ee-23, col_values=(('external_ids', {'iface-id': '8e59b4ee-23ce-4493-b08c-375e65f40354', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:b3:78', 'vm-uuid': 'c987b47a-7a27-48d8-af54-00f2df28e791'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:31 user nova-compute[72998]: INFO os_vif [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23')
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:56:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] No VIF found with MAC fa:16:3e:28:b3:78, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:56:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-5d05e29d-7a4a-47b7-b1df-5702c30bc39d req-68e876a0-0c0d-498b-8118-5c8d1a5f4eea service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:56:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5d05e29d-7a4a-47b7-b1df-5702c30bc39d req-68e876a0-0c0d-498b-8118-5c8d1a5f4eea service nova] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:56:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5d05e29d-7a4a-47b7-b1df-5702c30bc39d req-68e876a0-0c0d-498b-8118-5c8d1a5f4eea service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:56:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-5d05e29d-7a4a-47b7-b1df-5702c30bc39d req-68e876a0-0c0d-498b-8118-5c8d1a5f4eea service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:56:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-5d05e29d-7a4a-47b7-b1df-5702c30bc39d req-68e876a0-0c0d-498b-8118-5c8d1a5f4eea service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] No waiting events found dispatching network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:56:32 user nova-compute[72998]: WARNING nova.compute.manager [req-5d05e29d-7a4a-47b7-b1df-5702c30bc39d req-68e876a0-0c0d-498b-8118-5c8d1a5f4eea service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received unexpected event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 08:56:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262594.6584506, c987b47a-7a27-48d8-af54-00f2df28e791 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:56:34 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] VM Resumed (Lifecycle Event)
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 08:56:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Instance spawned successfully.
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:56:34 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262594.6596797, c987b47a-7a27-48d8-af54-00f2df28e791 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:56:34 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] VM Started (Lifecycle Event)
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a3621802-1dba-48a7-bc3b-bc8da9ccea7d tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.907s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.compute.manager [req-57c2feb8-14d8-41e4-b600-923ea79fd87f req-231af342-6e88-4cd9-8052-7d64e52fa838 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-57c2feb8-14d8-41e4-b600-923ea79fd87f req-231af342-6e88-4cd9-8052-7d64e52fa838 service nova] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-57c2feb8-14d8-41e4-b600-923ea79fd87f req-231af342-6e88-4cd9-8052-7d64e52fa838 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-57c2feb8-14d8-41e4-b600-923ea79fd87f req-231af342-6e88-4cd9-8052-7d64e52fa838 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:56:34 user nova-compute[72998]: DEBUG nova.compute.manager [req-57c2feb8-14d8-41e4-b600-923ea79fd87f req-231af342-6e88-4cd9-8052-7d64e52fa838 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] No waiting events found dispatching network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:56:34 user nova-compute[72998]: WARNING nova.compute.manager [req-57c2feb8-14d8-41e4-b600-923ea79fd87f req-231af342-6e88-4cd9-8052-7d64e52fa838 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received unexpected event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 for instance with vm_state active and task_state None.
Aug 17 08:56:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:56:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:56:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:56:36 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:56:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:56:37 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:56:37 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:56:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=24.066295623779297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4fe673a6-f634-4e82-9412-d30b6a02e254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c987b47a-7a27-48d8-af54-00f2df28e791 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:56:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:56:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:56:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:56:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:56:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:56:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:56:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:56:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:56:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:57:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:57:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:57:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:57:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:57:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:57:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:57:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:57:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:57:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:57:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:57:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:57:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:57:24 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:57:24 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:57:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:57:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:57:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:57:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:57:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:34 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:57:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:57:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:57:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:57:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:57:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:57:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:57:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:57:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:57:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:57:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:57:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:57:37 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:57:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:57:38 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:57:38 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:57:38 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=24.065624237060547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4fe673a6-f634-4e82-9412-d30b6a02e254 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c987b47a-7a27-48d8-af54-00f2df28e791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:57:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:57:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:57:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-e4edde5b-e85d-4ccc-aad0-4742fc2b5410 req-97612379-025d-4292-bf11-db0d9a1304dd service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received event network-changed-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:57:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-e4edde5b-e85d-4ccc-aad0-4742fc2b5410 req-97612379-025d-4292-bf11-db0d9a1304dd service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Refreshing instance network info cache due to event network-changed-4adbb317-5bd4-486b-a26a-090fda7121aa. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:57:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e4edde5b-e85d-4ccc-aad0-4742fc2b5410 req-97612379-025d-4292-bf11-db0d9a1304dd service nova] Acquiring lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:57:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e4edde5b-e85d-4ccc-aad0-4742fc2b5410 req-97612379-025d-4292-bf11-db0d9a1304dd service nova] Acquired lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:57:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-e4edde5b-e85d-4ccc-aad0-4742fc2b5410 req-97612379-025d-4292-bf11-db0d9a1304dd service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Refreshing network info cache for port 4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:57:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:57:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:57:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:57:44 user nova-compute[72998]: DEBUG nova.network.neutron [req-e4edde5b-e85d-4ccc-aad0-4742fc2b5410 req-97612379-025d-4292-bf11-db0d9a1304dd service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updated VIF entry in instance network info cache for port 4adbb317-5bd4-486b-a26a-090fda7121aa. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:57:44 user nova-compute[72998]: DEBUG nova.network.neutron [req-e4edde5b-e85d-4ccc-aad0-4742fc2b5410 req-97612379-025d-4292-bf11-db0d9a1304dd service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updating instance_info_cache with network_info: [{"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:57:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e4edde5b-e85d-4ccc-aad0-4742fc2b5410 req-97612379-025d-4292-bf11-db0d9a1304dd service nova] Releasing lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:57:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG nova.objects.instance [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lazy-loading 'flavor' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:57:45 user nova-compute[72998]: INFO nova.compute.manager [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Attaching volume c295cc10-64cf-4d29-95ff-4284aa2da1ad to /dev/vdb
Aug 17 08:57:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bccc0e9-1129-489d-94ac-ff090d3e6f6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a98fc4-ea18-4280-a2a8-185d3c3ede8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddeb873-c6a1-4f55-a38d-95e8ac9cbaa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a099878d-becf-46fe-9cf7-49684a9eb637]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:57:45 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:57:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5744df0b-954c-4a70-8935-f0b03cb135a3]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:57:45 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updating existing volume attachment record: 114a09bb-2dcf-408e-b45f-7ef49e37272a {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:57:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:57:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:57:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:57:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:57:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:57:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XndsBqvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:57:56 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:57:56 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:57:56 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf98937-f7dc-481a-be9c-c4039eba8cd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:57:56 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3946258-cc41-4f6d-a119-3d82ed3bf008]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad] added
Aug 17 08:57:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[781e2f09-64b7-42f0-8623-2d233f58da1d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2013c8-95f7-48c4-8683-a0c5923ede7d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XndsBqvI {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XndsBqvI" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd188cd-9e99-4d04-a968-3c6c6d2b83f6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XndsBqvI'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5152b6d2-06ca-4f70-80b8-d98894a693a3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e34204-dfa6-41b7-86fc-279202bc904d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:57:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:57:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eecc17c-a2f0-44b7-868d-1db188be852a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad, portal: 172.16.0.220,3260]
Aug 17 08:57:56 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad, portal: 172.16.0.220,3260] successful.
Aug 17 08:57:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5977bf6-1fee-4f98-8494-f5a42a02dcfb]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[157ee04a-ae1f-46e6-aac5-ae2c25c38c49]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:57:56 user nova-compute[72998]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:57:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:57:56 user nova-compute[72998]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:57:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[119db67f-833f-46ce-b889-c10b68302b61]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:57:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XndsBqvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:57:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:57:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26462313436316136', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:57:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462313436316136', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:57:57 user nova-compute[72998]: DEBUG nova.objects.instance [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lazy-loading 'flavor' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:57:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:57:57 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:57:57 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:57:57 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:57:57 user nova-compute[72998]:   <serial>c295cc10-64cf-4d29-95ff-4284aa2da1ad</serial>
Aug 17 08:57:57 user nova-compute[72998]: </disk>
Aug 17 08:57:57 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:57:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:57:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:57:58 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] No VIF found with MAC fa:16:3e:3e:2d:61, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:57:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-cb4a946f-f403-4bb7-8e48-809ba0c64c25 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.539s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lazy-loading 'flavor' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:00 user nova-compute[72998]: INFO nova.compute.manager [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Attaching volume 9f24c887-b205-480c-9b8a-8951fa277a52 to /dev/vdc
Aug 17 08:58:00 user nova-compute[72998]: DEBUG os_brick.utils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[465a9d27-ab6d-4eac-a862-a72b2037218c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d986aa-01dd-4632-8cee-de81e873097a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aa8348-a387-4a61-addd-4d16b89be2e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[931d64b7-babf-44ac-8864-65302ce5399b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:58:01 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:58:01 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ecb56c-f938-490e-94bf-623cbb19ce61]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG os_brick.utils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updating existing volume attachment record: f988664b-285c-433c-a820-02d9c3477c18 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-98276283-18fb-4eaf-9a74-a8bfb9b90482 req-3878d04e-7af9-4359-9ca8-b454e1ab9a81 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG nova.compute.manager [req-98276283-18fb-4eaf-9a74-a8bfb9b90482 req-3878d04e-7af9-4359-9ca8-b454e1ab9a81 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing instance network info cache due to event network-changed-8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-98276283-18fb-4eaf-9a74-a8bfb9b90482 req-3878d04e-7af9-4359-9ca8-b454e1ab9a81 service nova] Acquiring lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-98276283-18fb-4eaf-9a74-a8bfb9b90482 req-3878d04e-7af9-4359-9ca8-b454e1ab9a81 service nova] Acquired lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG nova.network.neutron [req-98276283-18fb-4eaf-9a74-a8bfb9b90482 req-3878d04e-7af9-4359-9ca8-b454e1ab9a81 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Refreshing network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:08 user nova-compute[72998]: INFO nova.compute.manager [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Terminating instance
Aug 17 08:58:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG nova.network.neutron [req-98276283-18fb-4eaf-9a74-a8bfb9b90482 req-3878d04e-7af9-4359-9ca8-b454e1ab9a81 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updated VIF entry in instance network info cache for port 8e59b4ee-23ce-4493-b08c-375e65f40354. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG nova.network.neutron [req-98276283-18fb-4eaf-9a74-a8bfb9b90482 req-3878d04e-7af9-4359-9ca8-b454e1ab9a81 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [{"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-98276283-18fb-4eaf-9a74-a8bfb9b90482 req-3878d04e-7af9-4359-9ca8-b454e1ab9a81 service nova] Releasing lock "refresh_cache-c987b47a-7a27-48d8-af54-00f2df28e791" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:58:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Instance destroyed successfully.
Aug 17 08:58:09 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lazy-loading 'resources' on Instance uuid c987b47a-7a27-48d8-af54-00f2df28e791 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T08:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-664239747',display_name='tempest-TestShelveInstance-server-664239747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-664239747',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQYj6FkGGatZqn06sBiQ9Njxrmu9SR3SKvltA/9HXZSlRQfrkHYXqv+z22JysW/R8oYjVb6fu8/VXk34I2+LhGcnchFc85jYSJpew+61NGka9TSC2RYfGui7mn6j3xDvQ==',key_name='tempest-TestShelveInstance-1614759485',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:56:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='776bff487ad04c93a39dacfc3792c23d',ramdisk_id='',reservation_id='r-fzjfzl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1410150597',owner_user_name='tempest-TestShelveInstance-1410150597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:56:35Z,user_data=None,user_id='2c4bba5f3cdf4e9a90d0d70152a84a62',uuid=c987b47a-7a27-48d8-af54-00f2df28e791,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converting VIF {"id": "8e59b4ee-23ce-4493-b08c-375e65f40354", "address": "fa:16:3e:28:b3:78", "network": {"id": "aa53db74-6ea3-48de-bcf6-e6c89ea27571", "bridge": "br-int", "label": "tempest-TestShelveInstance-1426394544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776bff487ad04c93a39dacfc3792c23d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e59b4ee-23", "ovs_interfaceid": "8e59b4ee-23ce-4493-b08c-375e65f40354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_vif [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e59b4ee-23, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:58:09 user nova-compute[72998]: INFO os_vif [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:b3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e59b4ee-23ce-4493-b08c-375e65f40354,network=Network(aa53db74-6ea3-48de-bcf6-e6c89ea27571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e59b4ee-23')
Aug 17 08:58:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVtiGWyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:58:09 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68037d9-5cba-4494-8a6b-0df49c36eab4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa77dad-53ce-4b16-a340-5de122b1baec]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:58:09 user nova-compute[72998]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:58:09 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b (non-flash)
Aug 17 08:58:09 user nova-compute[72998]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:58:09 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4883b85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1376e72-bb7a-4c80-8236-e567ba3a4c07]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfea3dd-4044-4984-b56c-9a0d3593a73a]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[485c5bff-e043-4dae-bac9-cac1fce21d7f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[335677cc-0c9a-433a-8e9e-8addf04bc96e]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_645f7809', '/dev/disk/by-id/scsi-1SCST_BIO645f7809-1f7735a423d3cb3a', '/dev/disk/by-id/scsi-23166373733356134') {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a852f1da-503d-4645-a1d8-50bb6af5e81e]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed0a3c2-9d0a-449f-881e-a9cbc259ce87]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d6760e-b6d6-4399-bc84-b825dd9831fb]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260]
Aug 17 08:58:09 user nova-compute[72998]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b, portal: 172.16.0.220,3260] successful.
Aug 17 08:58:09 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e3f6f6-d105-4e53-a563-f1cf844e0c9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7c868c-6d37-4790-9f2f-3d20992538cf]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] <== disconnect_volume: return (275ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:58:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:58:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Deleting instance files /opt/stack/data/nova/instances/c987b47a-7a27-48d8-af54-00f2df28e791_del
Aug 17 08:58:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Deletion of /opt/stack/data/nova/instances/c987b47a-7a27-48d8-af54-00f2df28e791_del complete
Aug 17 08:58:10 user nova-compute[72998]: INFO nova.compute.manager [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 17 08:58:10 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:58:10 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Took 0.82 seconds to deallocate network for instance.
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-bfacfdc4-d37d-4297-908e-91b63324dc2c req-916346b6-92d8-425a-8b66-e4a8a78969d2 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-deleted-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:58:10 user nova-compute[72998]: INFO nova.compute.manager [req-bfacfdc4-d37d-4297-908e-91b63324dc2c req-916346b6-92d8-425a-8b66-e4a8a78969d2 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Neutron deleted interface 8e59b4ee-23ce-4493-b08c-375e65f40354; detaching it from the instance and deleting it from the info cache
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.network.neutron [req-bfacfdc4-d37d-4297-908e-91b63324dc2c req-916346b6-92d8-425a-8b66-e4a8a78969d2 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-bfacfdc4-d37d-4297-908e-91b63324dc2c req-916346b6-92d8-425a-8b66-e4a8a78969d2 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Detach interface failed, port_id=8e59b4ee-23ce-4493-b08c-375e65f40354, reason: Instance c987b47a-7a27-48d8-af54-00f2df28e791 could not be found. {{(pid=72998) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-unplugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] No waiting events found dispatching network-vif-unplugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-unplugged-8e59b4ee-23ce-4493-b08c-375e65f40354 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] Acquiring lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] Lock "c987b47a-7a27-48d8-af54-00f2df28e791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:10 user nova-compute[72998]: DEBUG nova.compute.manager [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] No waiting events found dispatching network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:58:10 user nova-compute[72998]: WARNING nova.compute.manager [req-3d2be603-10e3-4995-b212-045bb823b209 req-f2ebf46b-225e-45ed-ba66-b0655263f173 service nova] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Received unexpected event network-vif-plugged-8e59b4ee-23ce-4493-b08c-375e65f40354 for instance with vm_state active and task_state deleting.
Aug 17 08:58:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptVPrdmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:58:11 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:58:11 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:58:11 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:58:11 user nova-compute[72998]: INFO nova.compute.manager [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Took 0.96 seconds to detach 1 volumes for instance.
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Deleting volume: 37e3f6f6-d105-4e53-a563-f1cf844e0c9b {{(pid=72998) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f8e350-91ed-4201-b55d-2670d68c8890]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:58:11 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7efb9-b2b6-49a6-85bf-5478ef4910a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52] added
Aug 17 08:58:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b9eec9-2d0d-4ede-9b80-1b8cf7ec961a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c0192b-6524-423f-ac8e-f064da08e4f4]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptVPrdmL {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptVPrdmL" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca61d56-a2ca-4ed6-9427-c8b4fe09c9b8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ptVPrdmL'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d5e44e-53cc-4aa6-9edd-25cdd9113c4e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4798b0-e1a1-4adf-afdc-8ccdb9504a84]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:58:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:58:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:58:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b10b5-f3f5-40f5-b8e3-5b0d1543b6e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52, portal: 172.16.0.220,3260]
Aug 17 08:58:12 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52, portal: 172.16.0.220,3260] successful.
Aug 17 08:58:12 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ecb55c-8474-47cd-b8b8-4a672a76046b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81516e7-627f-4f83-b6e3-23fa5c5ed690]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:58:12 user nova-compute[72998]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 (non-flash)
Aug 17 08:58:12 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:58:12 user nova-compute[72998]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 (non-flash)
Aug 17 08:58:12 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:12 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Deleted allocations for instance c987b47a-7a27-48d8-af54-00f2df28e791
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bccc283-e8e4-4f30-9791-a3aed2e4563a]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptVPrdmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:58:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e6511e6f-3189-45df-9a9f-e5dadea0c397 tempest-TestShelveInstance-1410150597 tempest-TestShelveInstance-1410150597-project-member] Lock "c987b47a-7a27-48d8-af54-00f2df28e791" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.286s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23966653065383937', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966653065383937', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lazy-loading 'flavor' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 08:58:13 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:58:13 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:58:13 user nova-compute[72998]:   <target dev="vdc" bus="virtio"/>
Aug 17 08:58:13 user nova-compute[72998]:   <serial>9f24c887-b205-480c-9b8a-8951fa277a52</serial>
Aug 17 08:58:13 user nova-compute[72998]: </disk>
Aug 17 08:58:13 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] No VIF found with MAC fa:16:3e:3e:2d:61, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:58:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7aaefecc-ec25-4eca-90a6-cdecdd336914 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.817s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:15 user nova-compute[72998]: INFO nova.compute.manager [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Detaching volume 9f24c887-b205-480c-9b8a-8951fa277a52
Aug 17 08:58:15 user nova-compute[72998]: INFO nova.virt.block_device [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Attempting to driver detach volume 9f24c887-b205-480c-9b8a-8951fa277a52 from mountpoint /dev/vdc
Aug 17 08:58:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Attempting to detach device vdc from instance 4fe673a6-f634-4e82-9412-d30b6a02e254 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:58:15 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:58:15 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:58:15 user nova-compute[72998]:   <target dev="vdc" bus="virtio"/>
Aug 17 08:58:15 user nova-compute[72998]:   <serial>9f24c887-b205-480c-9b8a-8951fa277a52</serial>
Aug 17 08:58:15 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 08:58:15 user nova-compute[72998]: </disk>
Aug 17 08:58:15 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:58:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Successfully detached device vdc from instance 4fe673a6-f634-4e82-9412-d30b6a02e254 from the persistent domain config.
Aug 17 08:58:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4fe673a6-f634-4e82-9412-d30b6a02e254 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:58:15 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:58:15 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 08:58:15 user nova-compute[72998]:   <target dev="vdc" bus="virtio"/>
Aug 17 08:58:15 user nova-compute[72998]:   <serial>9f24c887-b205-480c-9b8a-8951fa277a52</serial>
Aug 17 08:58:15 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 08:58:15 user nova-compute[72998]: </disk>
Aug 17 08:58:15 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692262695.5446436, 4fe673a6-f634-4e82-9412-d30b6a02e254 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:58:15 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Successfully detached device vdc from instance 4fe673a6-f634-4e82-9412-d30b6a02e254 from the live domain config.
Aug 17 08:58:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptVPrdmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:58:15 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[20923e58-701f-49d0-af48-bf86864795f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9215fb16-a81b-49e2-9754-2e126592b8e3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:58:15 user nova-compute[72998]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 (non-flash)
Aug 17 08:58:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:58:15 user nova-compute[72998]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 (non-flash)
Aug 17 08:58:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4885a7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ae456a-a07c-44b0-951d-8a45e91e5958]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff33f1-60e8-4155-a04f-a2ef7b8082aa]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405c231-db51-4162-9a95-c1489c915fff]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[771ec7bd-356e-4d94-8d28-f179b0209263]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebc0c5d-afea-4c9b-af4f-9d41544a7e37]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[feff85d2-31a4-4300-846e-4b202cefd1e0]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52, portal: 172.16.0.220,3260]
Aug 17 08:58:15 user nova-compute[72998]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52, portal: 172.16.0.220,3260] successful.
Aug 17 08:58:15 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f24c887-b205-480c-9b8a-8951fa277a52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d932aa-b28f-459c-82ed-fe8f030cb170]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] <== disconnect_volume: return (289ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:58:15 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:58:16 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lazy-loading 'flavor' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:58:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fd4cf606-0f60-4f48-8382-338eab2302a4 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.832s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692262689.6252441, c987b47a-7a27-48d8-af54-00f2df28e791 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 08:58:24 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] VM Stopped (Lifecycle Event)
Aug 17 08:58:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-f8a03948-a8d6-48de-b4f4-17d5802a809b None None] [instance: c987b47a-7a27-48d8-af54-00f2df28e791] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:58:24 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:58:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updating instance_info_cache with network_info: [{"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:58:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:58:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:58:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:38 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:38 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:58:38 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:39 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:58:39 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:58:39 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=24.06380844116211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4fe673a6-f634-4e82-9412-d30b6a02e254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:58:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:58:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:58:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:58:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:47 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:58:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:58:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:58:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:05 user nova-compute[72998]: INFO nova.compute.manager [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Detaching volume c295cc10-64cf-4d29-95ff-4284aa2da1ad
Aug 17 08:59:05 user nova-compute[72998]: INFO nova.virt.block_device [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Attempting to driver detach volume c295cc10-64cf-4d29-95ff-4284aa2da1ad from mountpoint /dev/vdb
Aug 17 08:59:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Attempting to detach device vdb from instance 4fe673a6-f634-4e82-9412-d30b6a02e254 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 08:59:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:59:05 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:59:05 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:59:05 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:59:05 user nova-compute[72998]:   <serial>c295cc10-64cf-4d29-95ff-4284aa2da1ad</serial>
Aug 17 08:59:05 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:59:05 user nova-compute[72998]: </disk>
Aug 17 08:59:05 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:59:05 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Successfully detached device vdb from instance 4fe673a6-f634-4e82-9412-d30b6a02e254 from the persistent domain config.
Aug 17 08:59:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fe673a6-f634-4e82-9412-d30b6a02e254 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 08:59:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 08:59:05 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:59:05 user nova-compute[72998]:   <source dev="/dev/sdc"/>
Aug 17 08:59:05 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 08:59:05 user nova-compute[72998]:   <serial>c295cc10-64cf-4d29-95ff-4284aa2da1ad</serial>
Aug 17 08:59:05 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 08:59:05 user nova-compute[72998]: </disk>
Aug 17 08:59:05 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692262746.0204358, 4fe673a6-f634-4e82-9412-d30b6a02e254 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 08:59:06 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Successfully detached device vdb from instance 4fe673a6-f634-4e82-9412-d30b6a02e254 from the live domain config.
Aug 17 08:59:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XndsBqvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:59:06 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[473049a0-3897-4cdc-b2f1-da34322aa00b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b595cf-9aeb-48af-83f8-9be056c700f0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:59:06 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad (non-flash)
Aug 17 08:59:06 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa48824ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fc4199-9d66-41ad-82e5-61c4c85fdd30]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54c49a7-ba57-413f-ada0-92c03ade402c]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[024b60af-4e40-4687-b1f9-5f6d0a6ff129]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bf5b0b-d580-4f27-8189-6b5fd1ce3909]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[672c1479-f897-47f5-bf7c-0ebb03b2f391]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[757c301a-7485-4a98-a176-1797ab2a0310]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad, portal: 172.16.0.220,3260]
Aug 17 08:59:06 user nova-compute[72998]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad, portal: 172.16.0.220,3260] successful.
Aug 17 08:59:06 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c295cc10-64cf-4d29-95ff-4284aa2da1ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f21f6-7a7a-4132-90b7-6a95a09e1a93]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] <== disconnect_volume: return (250ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:59:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 08:59:07 user nova-compute[72998]: DEBUG nova.objects.instance [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lazy-loading 'flavor' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:59:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-66801117-e1b8-4794-913f-eef30bdd0cc9 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.679s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:59:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 08:59:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 08:59:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:59:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:59:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 08:59:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:59:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updating instance_info_cache with network_info: [{"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:59:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-4fe673a6-f634-4e82-9412-d30b6a02e254" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:59:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 08:59:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:59:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:59:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "48eb953d-563d-4169-b59b-738b6c8a109a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "48eb953d-563d-4169-b59b-738b6c8a109a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 08:59:39 user nova-compute[72998]: INFO nova.compute.claims [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Claim successful on node user
Aug 17 08:59:39 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 08:59:39 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 08:59:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 08:59:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 08:59:39 user nova-compute[72998]: INFO nova.virt.block_device [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Booting with volume snapshot c38d6b49-58f3-43cd-8cd0-94f87215c639 at /dev/vda
Aug 17 08:59:39 user nova-compute[72998]: DEBUG nova.policy [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeab5ccaa12540cf950a9461460cb6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e261c30b0a34357895224cf4772b371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 08:59:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Successfully created port: e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 08:59:40 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:59:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:40 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 08:59:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Successfully updated port: e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquired lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-ff791734-0316-40c8-99cf-a958cb6122df req-39b7f4f4-fdba-4252-a021-7c97eb0b19cd service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received event network-changed-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-ff791734-0316-40c8-99cf-a958cb6122df req-39b7f4f4-fdba-4252-a021-7c97eb0b19cd service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Refreshing instance network info cache due to event network-changed-e148c061-59f6-4a53-a849-9036925a8e38. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ff791734-0316-40c8-99cf-a958cb6122df req-39b7f4f4-fdba-4252-a021-7c97eb0b19cd service nova] Acquiring lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 08:59:41 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:59:41 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=24.053447723388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 4fe673a6-f634-4e82-9412-d30b6a02e254 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 48eb953d-563d-4169-b59b-738b6c8a109a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:59:41 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Updating instance_info_cache with network_info: [{"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Releasing lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Instance network_info: |[{"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ff791734-0316-40c8-99cf-a958cb6122df req-39b7f4f4-fdba-4252-a021-7c97eb0b19cd service nova] Acquired lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG nova.network.neutron [req-ff791734-0316-40c8-99cf-a958cb6122df req-39b7f4f4-fdba-4252-a021-7c97eb0b19cd service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Refreshing network info cache for port e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG nova.network.neutron [req-ff791734-0316-40c8-99cf-a958cb6122df req-39b7f4f4-fdba-4252-a021-7c97eb0b19cd service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Updated VIF entry in instance network info cache for port e148c061-59f6-4a53-a849-9036925a8e38. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG nova.network.neutron [req-ff791734-0316-40c8-99cf-a958cb6122df req-39b7f4f4-fdba-4252-a021-7c97eb0b19cd service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Updating instance_info_cache with network_info: [{"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:59:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ff791734-0316-40c8-99cf-a958cb6122df req-39b7f4f4-fdba-4252-a021-7c97eb0b19cd service nova] Releasing lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 08:59:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b371b1-c23c-48c3-9551-c9bb4c439911]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51e02b8-f8e1-4640-bdff-ce6a0023f7d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9049fe45-dc70-448b-9df2-efa2c3496ba6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6194f575-00c6-4982-b478-61af179401f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 08:59:45 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 08:59:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f5834c-890a-45a3-9276-7d18aae64aa5]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:59:45 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Updating existing volume attachment record: f0ad3522-fa07-4ace-9a39-91b534fabc21 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 08:59:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:59:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:59:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 08:59:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:59:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 08:59:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:59:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:55 user nova-compute[72998]: INFO nova.compute.manager [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Terminating instance
Aug 17 08:59:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 08:59:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 08:59:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Creating image(s)
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Ensure instance console log exists: /opt/stack/data/nova/instances/48eb953d-563d-4169-b59b-738b6c8a109a/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Start _get_guest_xml network_info=[{"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f0ad3522-fa07-4ace-9a39-91b534fabc21', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKyYufSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48eb953d-563d-4169-b59b-738b6c8a109a', 'attached_at': '', 'detached_at': '', 'volume_id': 'cab4a2c6-ab72-40d1-848c-be7710eb64f9', 'serial': 'cab4a2c6-ab72-40d1-848c-be7710eb64f9'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 08:59:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:59:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKyYufSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 08:59:56 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:59:56 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 08:59:56 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f923f-cbf4-4d00-bf4a-2a8cd180a9e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 08:59:56 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1981e8b2-3ee9-490f-8e1b-1f3ce33c7275]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9] added
Aug 17 08:59:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f6fcf2-be41-457b-8472-1cf96a56e6a6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-312a4691-be78-4d30-94e7-28de7c173a54 req-65c5b48f-ae15-4dc4-98d4-19abdb6dd83c service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received event network-vif-unplugged-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-312a4691-be78-4d30-94e7-28de7c173a54 req-65c5b48f-ae15-4dc4-98d4-19abdb6dd83c service nova] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-312a4691-be78-4d30-94e7-28de7c173a54 req-65c5b48f-ae15-4dc4-98d4-19abdb6dd83c service nova] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-312a4691-be78-4d30-94e7-28de7c173a54 req-65c5b48f-ae15-4dc4-98d4-19abdb6dd83c service nova] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-312a4691-be78-4d30-94e7-28de7c173a54 req-65c5b48f-ae15-4dc4-98d4-19abdb6dd83c service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] No waiting events found dispatching network-vif-unplugged-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-312a4691-be78-4d30-94e7-28de7c173a54 req-65c5b48f-ae15-4dc4-98d4-19abdb6dd83c service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received event network-vif-unplugged-4adbb317-5bd4-486b-a26a-090fda7121aa for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de9f17c-1299-4549-8f0f-9e07e6645eee]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKyYufSJ {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKyYufSJ" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f44ff6-3b3f-47dc-96a6-b3667b4ff5d2]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKyYufSJ'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda48f0e-c972-407a-baec-7f4589d5f82a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[52257e37-b3fc-4b96-845c-df093b548acd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:59:56 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 08:59:56 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:59:56 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 08:59:56 user nova-compute[72998]: 
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bd10df-3104-4aa3-b86a-ecc9fbf3e538]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9, portal: 172.16.0.220,3260]
Aug 17 08:59:56 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9, portal: 172.16.0.220,3260] successful.
Aug 17 08:59:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e106aea-6c7f-43a0-9ac1-940609d98cd1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[605a7862-57c9-4f8e-8090-5a1a439b4853]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 (non-flash)
Aug 17 08:59:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 (non-flash)
Aug 17 08:59:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba263214-0c37-4080-9b5c-0f2ce612523d]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKyYufSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 08:59:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Instance destroyed successfully.
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lazy-loading 'resources' on Instance uuid 4fe673a6-f634-4e82-9412-d30b6a02e254 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:55:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-877129420',display_name='tempest-TestServerVolumeAttachmentScenario-server-877129420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-877129420',id=45,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIt1+mdfMHwdvlFVQBkIEyPPgTimTp/fNtZPQ2FTxGt+O4yqfeiGB642U+YhsUEzgKe0vkijKd9hRn+fIQ0w92M2yzueSmQFQcIweAJVvZ4dWNKsG+7TLIui5O+8gTfWA==',key_name='tempest-keypair-1932501436',keypairs=<?>,launch_index=0,launched_at=2023-08-17T08:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22b8010fbf8045489796ec1d9c6ffb45',ramdisk_id='',reservation_id='r-r2g9huzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2049281515',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2049281515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T08:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c79e5446b1e74d4ba51b23ef1a4cdfcc',uuid=4fe673a6-f634-4e82-9412-d30b6a02e254,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Converting VIF {"id": "4adbb317-5bd4-486b-a26a-090fda7121aa", "address": "fa:16:3e:3e:2d:61", "network": {"id": "e057e3a8-654f-4d48-b90e-a3d97515a231", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-614181519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b8010fbf8045489796ec1d9c6ffb45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adbb317-5b", "ovs_interfaceid": "4adbb317-5bd4-486b-a26a-090fda7121aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2d:61,bridge_name='br-int',has_traffic_filtering=True,id=4adbb317-5bd4-486b-a26a-090fda7121aa,network=Network(e057e3a8-654f-4d48-b90e-a3d97515a231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adbb317-5b') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG os_vif [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2d:61,bridge_name='br-int',has_traffic_filtering=True,id=4adbb317-5bd4-486b-a26a-090fda7121aa,network=Network(e057e3a8-654f-4d48-b90e-a3d97515a231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adbb317-5b') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4adbb317-5b, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:59:56 user nova-compute[72998]: INFO os_vif [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2d:61,bridge_name='br-int',has_traffic_filtering=True,id=4adbb317-5bd4-486b-a26a-090fda7121aa,network=Network(e057e3a8-654f-4d48-b90e-a3d97515a231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adbb317-5b')
Aug 17 08:59:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Deleting instance files /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254_del
Aug 17 08:59:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Deletion of /opt/stack/data/nova/instances/4fe673a6-f634-4e82-9412-d30b6a02e254_del complete
Aug 17 08:59:56 user nova-compute[72998]: INFO nova.compute.manager [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 08:59:56 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 08:59:56 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23937373031643638', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937373031643638', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1040874036',display_name='tempest-TestVolumeBootPattern-server-1040874036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1040874036',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-ts4gjep7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:59:40Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=48eb953d-563d-4169-b59b-738b6c8a109a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:73:20,bridge_name='br-int',has_traffic_filtering=True,id=e148c061-59f6-4a53-a849-9036925a8e38,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c061-59') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.objects.instance [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'pci_devices' on Instance uuid 48eb953d-563d-4169-b59b-738b6c8a109a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 08:59:57 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Took 0.75 seconds to deallocate network for instance.
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 08:59:57 user nova-compute[72998]:   <uuid>48eb953d-563d-4169-b59b-738b6c8a109a</uuid>
Aug 17 08:59:57 user nova-compute[72998]:   <name>instance-0000002e</name>
Aug 17 08:59:57 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 08:59:57 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 08:59:57 user nova-compute[72998]:   <metadata>
Aug 17 08:59:57 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 08:59:57 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 08:59:57 user nova-compute[72998]:       <nova:name>tempest-TestVolumeBootPattern-server-1040874036</nova:name>
Aug 17 08:59:57 user nova-compute[72998]:       <nova:creationTime>2023-08-17 08:59:56</nova:creationTime>
Aug 17 08:59:57 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 08:59:57 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 08:59:57 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 08:59:57 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 08:59:57 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 08:59:57 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 08:59:57 user nova-compute[72998]:       </nova:flavor>
Aug 17 08:59:57 user nova-compute[72998]:       <nova:owner>
Aug 17 08:59:57 user nova-compute[72998]:         <nova:user uuid="eeab5ccaa12540cf950a9461460cb6ae">tempest-TestVolumeBootPattern-496980120-project-member</nova:user>
Aug 17 08:59:57 user nova-compute[72998]:         <nova:project uuid="3e261c30b0a34357895224cf4772b371">tempest-TestVolumeBootPattern-496980120</nova:project>
Aug 17 08:59:57 user nova-compute[72998]:       </nova:owner>
Aug 17 08:59:57 user nova-compute[72998]:       <nova:ports>
Aug 17 08:59:57 user nova-compute[72998]:         <nova:port uuid="e148c061-59f6-4a53-a849-9036925a8e38">
Aug 17 08:59:57 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 08:59:57 user nova-compute[72998]:         </nova:port>
Aug 17 08:59:57 user nova-compute[72998]:       </nova:ports>
Aug 17 08:59:57 user nova-compute[72998]:     </nova:instance>
Aug 17 08:59:57 user nova-compute[72998]:   </metadata>
Aug 17 08:59:57 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 08:59:57 user nova-compute[72998]:     <system>
Aug 17 08:59:57 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 08:59:57 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 08:59:57 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 08:59:57 user nova-compute[72998]:       <entry name="serial">48eb953d-563d-4169-b59b-738b6c8a109a</entry>
Aug 17 08:59:57 user nova-compute[72998]:       <entry name="uuid">48eb953d-563d-4169-b59b-738b6c8a109a</entry>
Aug 17 08:59:57 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 08:59:57 user nova-compute[72998]:     </system>
Aug 17 08:59:57 user nova-compute[72998]:   </sysinfo>
Aug 17 08:59:57 user nova-compute[72998]:   <os>
Aug 17 08:59:57 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 08:59:57 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 08:59:57 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 08:59:57 user nova-compute[72998]:   </os>
Aug 17 08:59:57 user nova-compute[72998]:   <features>
Aug 17 08:59:57 user nova-compute[72998]:     <acpi/>
Aug 17 08:59:57 user nova-compute[72998]:     <apic/>
Aug 17 08:59:57 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 08:59:57 user nova-compute[72998]:   </features>
Aug 17 08:59:57 user nova-compute[72998]:   <clock offset="utc">
Aug 17 08:59:57 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 08:59:57 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 08:59:57 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 08:59:57 user nova-compute[72998]:   </clock>
Aug 17 08:59:57 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 08:59:57 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 08:59:57 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 08:59:57 user nova-compute[72998]:   </cpu>
Aug 17 08:59:57 user nova-compute[72998]:   <devices>
Aug 17 08:59:57 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 08:59:57 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 08:59:57 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 08:59:57 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 08:59:57 user nova-compute[72998]:       <serial>cab4a2c6-ab72-40d1-848c-be7710eb64f9</serial>
Aug 17 08:59:57 user nova-compute[72998]:     </disk>
Aug 17 08:59:57 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 08:59:57 user nova-compute[72998]:       <mac address="fa:16:3e:66:73:20"/>
Aug 17 08:59:57 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:59:57 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 08:59:57 user nova-compute[72998]:       <target dev="tape148c061-59"/>
Aug 17 08:59:57 user nova-compute[72998]:     </interface>
Aug 17 08:59:57 user nova-compute[72998]:     <serial type="pty">
Aug 17 08:59:57 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/48eb953d-563d-4169-b59b-738b6c8a109a/console.log" append="off"/>
Aug 17 08:59:57 user nova-compute[72998]:     </serial>
Aug 17 08:59:57 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 08:59:57 user nova-compute[72998]:     <video>
Aug 17 08:59:57 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 08:59:57 user nova-compute[72998]:     </video>
Aug 17 08:59:57 user nova-compute[72998]:     <rng model="virtio">
Aug 17 08:59:57 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 08:59:57 user nova-compute[72998]:     </rng>
Aug 17 08:59:57 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 08:59:57 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 08:59:57 user nova-compute[72998]:       <stats period="10"/>
Aug 17 08:59:57 user nova-compute[72998]:     </memballoon>
Aug 17 08:59:57 user nova-compute[72998]:   </devices>
Aug 17 08:59:57 user nova-compute[72998]: </domain>
Aug 17 08:59:57 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1040874036',display_name='tempest-TestVolumeBootPattern-server-1040874036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1040874036',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-ts4gjep7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T08:59:40Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=48eb953d-563d-4169-b59b-738b6c8a109a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:73:20,bridge_name='br-int',has_traffic_filtering=True,id=e148c061-59f6-4a53-a849-9036925a8e38,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c061-59') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG os_vif [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:73:20,bridge_name='br-int',has_traffic_filtering=True,id=e148c061-59f6-4a53-a849-9036925a8e38,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c061-59') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape148c061-59, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape148c061-59, col_values=(('external_ids', {'iface-id': 'e148c061-59f6-4a53-a849-9036925a8e38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:73:20', 'vm-uuid': '48eb953d-563d-4169-b59b-738b6c8a109a'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:57 user nova-compute[72998]: INFO os_vif [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:73:20,bridge_name='br-int',has_traffic_filtering=True,id=e148c061-59f6-4a53-a849-9036925a8e38,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c061-59')
Aug 17 08:59:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No VIF found with MAC fa:16:3e:66:73:20, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 08:59:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:57 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Deleted allocations for instance 4fe673a6-f634-4e82-9412-d30b6a02e254
Aug 17 08:59:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-29af584d-a7b7-4651-bb2f-d7c797213579 tempest-TestServerVolumeAttachmentScenario-2049281515 tempest-TestServerVolumeAttachmentScenario-2049281515-project-member] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.007s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-0acbcfa6-1de9-44d6-aa43-1efe43a47dde req-2ffdc5cd-f92f-4367-a022-ec89f7c8fd96 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received event network-vif-plugged-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:59:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0acbcfa6-1de9-44d6-aa43-1efe43a47dde req-2ffdc5cd-f92f-4367-a022-ec89f7c8fd96 service nova] Acquiring lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 08:59:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0acbcfa6-1de9-44d6-aa43-1efe43a47dde req-2ffdc5cd-f92f-4367-a022-ec89f7c8fd96 service nova] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 08:59:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0acbcfa6-1de9-44d6-aa43-1efe43a47dde req-2ffdc5cd-f92f-4367-a022-ec89f7c8fd96 service nova] Lock "4fe673a6-f634-4e82-9412-d30b6a02e254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 08:59:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-0acbcfa6-1de9-44d6-aa43-1efe43a47dde req-2ffdc5cd-f92f-4367-a022-ec89f7c8fd96 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] No waiting events found dispatching network-vif-plugged-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 08:59:58 user nova-compute[72998]: WARNING nova.compute.manager [req-0acbcfa6-1de9-44d6-aa43-1efe43a47dde req-2ffdc5cd-f92f-4367-a022-ec89f7c8fd96 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received unexpected event network-vif-plugged-4adbb317-5bd4-486b-a26a-090fda7121aa for instance with vm_state deleted and task_state None.
Aug 17 08:59:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-0acbcfa6-1de9-44d6-aa43-1efe43a47dde req-2ffdc5cd-f92f-4367-a022-ec89f7c8fd96 service nova] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Received event network-vif-deleted-4adbb317-5bd4-486b-a26a-090fda7121aa {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 08:59:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 08:59:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received event network-vif-plugged-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:00:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] Acquiring lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:00:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:00:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:00:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] No waiting events found dispatching network-vif-plugged-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:00:00 user nova-compute[72998]: WARNING nova.compute.manager [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received unexpected event network-vif-plugged-e148c061-59f6-4a53-a849-9036925a8e38 for instance with vm_state building and task_state spawning.
Aug 17 09:00:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received event network-vif-plugged-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:00:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] Acquiring lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:00:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:00:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:00:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] No waiting events found dispatching network-vif-plugged-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:00:00 user nova-compute[72998]: WARNING nova.compute.manager [req-4bff6e7b-dc3a-44a1-84f8-6bf85335e858 req-871ac861-108b-4357-bd11-b9f767906145 service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received unexpected event network-vif-plugged-e148c061-59f6-4a53-a849-9036925a8e38 for instance with vm_state building and task_state spawning.
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262801.2158105, 48eb953d-563d-4169-b59b-738b6c8a109a => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:00:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] VM Resumed (Lifecycle Event)
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 09:00:01 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Instance spawned successfully.
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:00:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262801.2168593, 48eb953d-563d-4169-b59b-738b6c8a109a => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:00:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] VM Started (Lifecycle Event)
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:00:01 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:00:01 user nova-compute[72998]: INFO nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Took 5.25 seconds to spawn the instance on the hypervisor.
Aug 17 09:00:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:00:01 user nova-compute[72998]: INFO nova.compute.manager [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Took 21.87 seconds to build instance.
Aug 17 09:00:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-2ad028c5-31be-4439-9343-624501c7b83f tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "48eb953d-563d-4169-b59b-738b6c8a109a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.052s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:00:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:00:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:00:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:00:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:11 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692262796.6326153, 4fe673a6-f634-4e82-9412-d30b6a02e254 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:00:11 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] VM Stopped (Lifecycle Event)
Aug 17 09:00:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1e95081b-95d9-4acc-a357-41a5cbe23adb None None] [instance: 4fe673a6-f634-4e82-9412-d30b6a02e254] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:00:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:00:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:00:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:26 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:00:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:00:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:00:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:00:26 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:00:26 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 48eb953d-563d-4169-b59b-738b6c8a109a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:00:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Updating instance_info_cache with network_info: [{"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:00:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:00:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:00:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:00:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:00:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:00:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:00:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:00:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=24.079757690429688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 48eb953d-563d-4169-b59b-738b6c8a109a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:00:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:00:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 09:00:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:00:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:49 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:00:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:00:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:00:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:00:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:00:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 09:00:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 09:00:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:00:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:01:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:01:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:01:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:01:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:01:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:01:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:01:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:01:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:01:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:01:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:01:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:01:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:26 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:01:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid 48eb953d-563d-4169-b59b-738b6c8a109a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Updating instance_info_cache with network_info: [{"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-48eb953d-563d-4169-b59b-738b6c8a109a" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:01:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "48eb953d-563d-4169-b59b-738b6c8a109a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "48eb953d-563d-4169-b59b-738b6c8a109a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:01:30 user nova-compute[72998]: INFO nova.compute.manager [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Terminating instance
Aug 17 09:01:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-c70ef6ef-179c-4eef-8438-6dccc9251671 req-ae014762-0510-4961-a52d-2802a45de474 service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received event network-vif-unplugged-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c70ef6ef-179c-4eef-8438-6dccc9251671 req-ae014762-0510-4961-a52d-2802a45de474 service nova] Acquiring lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c70ef6ef-179c-4eef-8438-6dccc9251671 req-ae014762-0510-4961-a52d-2802a45de474 service nova] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c70ef6ef-179c-4eef-8438-6dccc9251671 req-ae014762-0510-4961-a52d-2802a45de474 service nova] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-c70ef6ef-179c-4eef-8438-6dccc9251671 req-ae014762-0510-4961-a52d-2802a45de474 service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] No waiting events found dispatching network-vif-unplugged-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG nova.compute.manager [req-c70ef6ef-179c-4eef-8438-6dccc9251671 req-ae014762-0510-4961-a52d-2802a45de474 service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received event network-vif-unplugged-e148c061-59f6-4a53-a849-9036925a8e38 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:30 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Instance destroyed successfully.
Aug 17 09:01:30 user nova-compute[72998]: DEBUG nova.objects.instance [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'resources' on Instance uuid 48eb953d-563d-4169-b59b-738b6c8a109a {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T08:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1040874036',display_name='tempest-TestVolumeBootPattern-server-1040874036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1040874036',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T09:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-ts4gjep7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T09:00:01Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=48eb953d-563d-4169-b59b-738b6c8a109a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "e148c061-59f6-4a53-a849-9036925a8e38", "address": "fa:16:3e:66:73:20", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c061-59", "ovs_interfaceid": "e148c061-59f6-4a53-a849-9036925a8e38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:73:20,bridge_name='br-int',has_traffic_filtering=True,id=e148c061-59f6-4a53-a849-9036925a8e38,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c061-59') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG os_vif [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:73:20,bridge_name='br-int',has_traffic_filtering=True,id=e148c061-59f6-4a53-a849-9036925a8e38,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c061-59') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape148c061-59, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:01:30 user nova-compute[72998]: INFO os_vif [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:73:20,bridge_name='br-int',has_traffic_filtering=True,id=e148c061-59f6-4a53-a849-9036925a8e38,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c061-59')
Aug 17 09:01:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKyYufSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:01:30 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:01:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[50754429-22bd-416b-b147-977f5915dbf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeeb8c7-f1e4-4152-a22d-b2a018130176]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 (non-flash)
Aug 17 09:01:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 (non-flash)
Aug 17 09:01:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4883e7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0612a8f-7135-472e-962c-fca20df6da56]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8a5143-fc85-423f-bf19-3751cbdd138f]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fb0ca3-ae25-46ca-a8e3-f52d8a4bd5b2]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[519155b3-a723-431a-9831-c886ea9257c5]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23937373031643638', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_53f08d31', '/dev/disk/by-id/scsi-1SCST_BIO53f08d31-97701d689efff38a') {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e123aaed-270b-4dcc-8ac4-98850c86947a]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c6ca4d-a934-4d60-ae80-efb3d63011cb]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8456e584-5d1b-4a91-8343-1bbc659100e2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9, portal: 172.16.0.220,3260]
Aug 17 09:01:31 user nova-compute[72998]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9, portal: 172.16.0.220,3260] successful.
Aug 17 09:01:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cab4a2c6-ab72-40d1-848c-be7710eb64f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[44de69db-8afe-47da-a204-1528865abd09]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== disconnect_volume: return (293ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:01:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Deleting instance files /opt/stack/data/nova/instances/48eb953d-563d-4169-b59b-738b6c8a109a_del
Aug 17 09:01:31 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Deletion of /opt/stack/data/nova/instances/48eb953d-563d-4169-b59b-738b6c8a109a_del complete
Aug 17 09:01:31 user nova-compute[72998]: INFO nova.compute.manager [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 17 09:01:31 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 09:01:31 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:01:31 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Took 0.42 seconds to deallocate network for instance.
Aug 17 09:01:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-0aa0a70a-470b-4ee6-8167-fa488743d81b req-7afbaf66-3cf7-435a-bc8e-0cb5ecebc92b service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received event network-vif-plugged-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:01:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0aa0a70a-470b-4ee6-8167-fa488743d81b req-7afbaf66-3cf7-435a-bc8e-0cb5ecebc92b service nova] Acquiring lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:01:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0aa0a70a-470b-4ee6-8167-fa488743d81b req-7afbaf66-3cf7-435a-bc8e-0cb5ecebc92b service nova] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:01:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-0aa0a70a-470b-4ee6-8167-fa488743d81b req-7afbaf66-3cf7-435a-bc8e-0cb5ecebc92b service nova] Lock "48eb953d-563d-4169-b59b-738b6c8a109a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:01:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-0aa0a70a-470b-4ee6-8167-fa488743d81b req-7afbaf66-3cf7-435a-bc8e-0cb5ecebc92b service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] No waiting events found dispatching network-vif-plugged-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:01:32 user nova-compute[72998]: WARNING nova.compute.manager [req-0aa0a70a-470b-4ee6-8167-fa488743d81b req-7afbaf66-3cf7-435a-bc8e-0cb5ecebc92b service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received unexpected event network-vif-plugged-e148c061-59f6-4a53-a849-9036925a8e38 for instance with vm_state active and task_state deleting.
Aug 17 09:01:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-0aa0a70a-470b-4ee6-8167-fa488743d81b req-7afbaf66-3cf7-435a-bc8e-0cb5ecebc92b service nova] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Received event network-vif-deleted-e148c061-59f6-4a53-a849-9036925a8e38 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:01:32 user nova-compute[72998]: INFO nova.compute.manager [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 09:01:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Deleting volume: cab4a2c6-ab72-40d1-848c-be7710eb64f9 {{(pid=72998) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 09:01:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:01:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:01:32 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:01:32 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:01:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:01:32 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Deleted allocations for instance 48eb953d-563d-4169-b59b-738b6c8a109a
Aug 17 09:01:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5f8c090e-1a5d-4e5f-b9b8-2b797d4beba2 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "48eb953d-563d-4169-b59b-738b6c8a109a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.892s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:01:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:40 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:01:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:01:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:01:42 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:01:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:01:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:01:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=24.07817840576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:01:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:01:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:01:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:01:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:01:43 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:01:43 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:01:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:01:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:01:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:45 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:45 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692262890.9323862, 48eb953d-563d-4169-b59b-738b6c8a109a => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:01:45 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] VM Stopped (Lifecycle Event)
Aug 17 09:01:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e73cf3df-c58c-46a5-b6b4-0bd0c9b046d6 None None] [instance: 48eb953d-563d-4169-b59b-738b6c8a109a] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:01:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:01:47 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:01:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:50 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:01:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:01:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:02:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:02:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:02:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:02:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:02:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:02:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:02:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:27 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:02:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:02:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:02:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:02:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:02:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:02:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:02:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:02:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:02:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:02:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:02:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:02:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:02:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:02:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:02:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:02:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:02:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:02:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:02:42 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:02:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:02:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:02:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=24.077194213867188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:02:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:02:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:02:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:02:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:02:43 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:02:43 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:02:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:02:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:02:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "c00f2167-19cf-4ca0-8604-3dac17215b8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:02:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:02:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 09:02:45 user nova-compute[72998]: INFO nova.compute.claims [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Claim successful on node user
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.171s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 09:02:45 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.policy [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeab5ccaa12540cf950a9461460cb6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e261c30b0a34357895224cf4772b371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 09:02:45 user nova-compute[72998]: INFO nova.virt.block_device [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Booting with volume 2855e4d0-e1b4-4f05-9516-b9b528b15d14 at /dev/vda
Aug 17 09:02:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f54838-c95f-45b0-a293-44962628af70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60dd66d-d300-4f63-b71a-b0ff5b39b696]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a08a35f-3f4e-49a8-b28d-9684968fd921]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[be150c6a-9276-4796-ba2d-01336386c293]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:02:45 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:02:45 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8213911a-7200-4076-8781-775400143e9b]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG os_brick.utils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updating existing volume attachment record: fb52de54-9f9c-4731-9c2b-61295364d6cb {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Successfully created port: 8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 09:02:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:46 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Successfully updated port: 8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 09:02:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:02:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquired lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:02:46 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 09:02:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-167a3064-428c-4e9e-9d84-ab24387a78d2 req-c4c86a37-d5be-41af-b571-9f42e8927f7b service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received event network-changed-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:02:46 user nova-compute[72998]: DEBUG nova.compute.manager [req-167a3064-428c-4e9e-9d84-ab24387a78d2 req-c4c86a37-d5be-41af-b571-9f42e8927f7b service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Refreshing instance network info cache due to event network-changed-8281f63a-3e49-4bac-8830-6af5b8518ec7. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:02:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-167a3064-428c-4e9e-9d84-ab24387a78d2 req-c4c86a37-d5be-41af-b571-9f42e8927f7b service nova] Acquiring lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:02:46 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 09:02:47 user nova-compute[72998]: DEBUG nova.network.neutron [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updating instance_info_cache with network_info: [{"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:02:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Releasing lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:02:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Instance network_info: |[{"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 09:02:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-167a3064-428c-4e9e-9d84-ab24387a78d2 req-c4c86a37-d5be-41af-b571-9f42e8927f7b service nova] Acquired lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:02:47 user nova-compute[72998]: DEBUG nova.network.neutron [req-167a3064-428c-4e9e-9d84-ab24387a78d2 req-c4c86a37-d5be-41af-b571-9f42e8927f7b service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Refreshing network info cache for port 8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:02:47 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:02:47 user nova-compute[72998]: DEBUG nova.network.neutron [req-167a3064-428c-4e9e-9d84-ab24387a78d2 req-c4c86a37-d5be-41af-b571-9f42e8927f7b service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updated VIF entry in instance network info cache for port 8281f63a-3e49-4bac-8830-6af5b8518ec7. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:02:47 user nova-compute[72998]: DEBUG nova.network.neutron [req-167a3064-428c-4e9e-9d84-ab24387a78d2 req-c4c86a37-d5be-41af-b571-9f42e8927f7b service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updating instance_info_cache with network_info: [{"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:02:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-167a3064-428c-4e9e-9d84-ab24387a78d2 req-c4c86a37-d5be-41af-b571-9f42e8927f7b service nova] Releasing lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:02:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:02:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:02:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:02:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:02:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:02:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:02:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:02:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 09:02:55 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Creating image(s)
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Ensure instance console log exists: /opt/stack/data/nova/instances/c00f2167-19cf-4ca0-8604-3dac17215b8d/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Start _get_guest_xml network_info=[{"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fb52de54-9f9c-4731-9c2b-61295364d6cb', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxfmGwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c00f2167-19cf-4ca0-8604-3dac17215b8d', 'attached_at': '', 'detached_at': '', 'volume_id': '2855e4d0-e1b4-4f05-9516-b9b528b15d14', 'serial': '2855e4d0-e1b4-4f05-9516-b9b528b15d14'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 09:02:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:02:55 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxfmGwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:02:55 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:02:55 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:02:55 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[589294d5-c00d-48db-8256-7467664df1ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:02:55 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa27d44d-ea84-424d-bbce-b1b28c5da0f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14] added
Aug 17 09:02:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f18dfc1-48eb-4b35-830c-1c46178892cb]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae3ac0b-f6a0-44a9-bed2-22339774630e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZxfmGwq {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZxfmGwq" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c22ef1-0944-4afe-9ceb-6bed95cd2a66]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZxfmGwq'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38099dc-753b-409d-ab44-90d748bbd6d9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:02:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76c1185-6fdb-4dc6-9f85-3a977360c21b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:02:56 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:02:56 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:02:56 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:02:56 user nova-compute[72998]: 
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d364d4-b3f1-4a3f-b8d7-e2cdbfd507d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14, portal: 172.16.0.220,3260]
Aug 17 09:02:56 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14, portal: 172.16.0.220,3260] successful.
Aug 17 09:02:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bd8148-ddde-4e0e-a5db-dd3cbc68dd8b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0250dff3-1a46-4c1a-97f4-44d5f2afbfc1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:02:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:02:56 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d963ac-1577-45f5-a525-a65a0be76b54]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:02:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxfmGwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23130643338636364', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130643338636364', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1756852222',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1756852222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1756852222',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYvL2xIqYuv8w9IwkFvU+ZcMJFc4NdSGWZu2nOjGBKMWQ2RyI0+Dh3xTAZWR7lEklTNusDs7HrmkiAJ0H3ag3Ic9WiZv4kxXCjXyPTYVZHWVJLA0zwvyfinAwVr4Uyvag==',key_name='tempest-keypair-1765114348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-fvcbjdvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=c00f2167-19cf-4ca0-8604-3dac17215b8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=8281f63a-3e49-4bac-8830-6af5b8518ec7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8281f63a-3e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.objects.instance [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'pci_devices' on Instance uuid c00f2167-19cf-4ca0-8604-3dac17215b8d {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 09:02:57 user nova-compute[72998]:   <uuid>c00f2167-19cf-4ca0-8604-3dac17215b8d</uuid>
Aug 17 09:02:57 user nova-compute[72998]:   <name>instance-0000002f</name>
Aug 17 09:02:57 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 09:02:57 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 09:02:57 user nova-compute[72998]:   <metadata>
Aug 17 09:02:57 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 09:02:57 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 09:02:57 user nova-compute[72998]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1756852222</nova:name>
Aug 17 09:02:57 user nova-compute[72998]:       <nova:creationTime>2023-08-17 09:02:55</nova:creationTime>
Aug 17 09:02:57 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 09:02:57 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 09:02:57 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 09:02:57 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 09:02:57 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 09:02:57 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 09:02:57 user nova-compute[72998]:       </nova:flavor>
Aug 17 09:02:57 user nova-compute[72998]:       <nova:owner>
Aug 17 09:02:57 user nova-compute[72998]:         <nova:user uuid="eeab5ccaa12540cf950a9461460cb6ae">tempest-TestVolumeBootPattern-496980120-project-member</nova:user>
Aug 17 09:02:57 user nova-compute[72998]:         <nova:project uuid="3e261c30b0a34357895224cf4772b371">tempest-TestVolumeBootPattern-496980120</nova:project>
Aug 17 09:02:57 user nova-compute[72998]:       </nova:owner>
Aug 17 09:02:57 user nova-compute[72998]:       <nova:ports>
Aug 17 09:02:57 user nova-compute[72998]:         <nova:port uuid="8281f63a-3e49-4bac-8830-6af5b8518ec7">
Aug 17 09:02:57 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 09:02:57 user nova-compute[72998]:         </nova:port>
Aug 17 09:02:57 user nova-compute[72998]:       </nova:ports>
Aug 17 09:02:57 user nova-compute[72998]:     </nova:instance>
Aug 17 09:02:57 user nova-compute[72998]:   </metadata>
Aug 17 09:02:57 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 09:02:57 user nova-compute[72998]:     <system>
Aug 17 09:02:57 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 09:02:57 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 09:02:57 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 09:02:57 user nova-compute[72998]:       <entry name="serial">c00f2167-19cf-4ca0-8604-3dac17215b8d</entry>
Aug 17 09:02:57 user nova-compute[72998]:       <entry name="uuid">c00f2167-19cf-4ca0-8604-3dac17215b8d</entry>
Aug 17 09:02:57 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 09:02:57 user nova-compute[72998]:     </system>
Aug 17 09:02:57 user nova-compute[72998]:   </sysinfo>
Aug 17 09:02:57 user nova-compute[72998]:   <os>
Aug 17 09:02:57 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 09:02:57 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 09:02:57 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 09:02:57 user nova-compute[72998]:   </os>
Aug 17 09:02:57 user nova-compute[72998]:   <features>
Aug 17 09:02:57 user nova-compute[72998]:     <acpi/>
Aug 17 09:02:57 user nova-compute[72998]:     <apic/>
Aug 17 09:02:57 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 09:02:57 user nova-compute[72998]:   </features>
Aug 17 09:02:57 user nova-compute[72998]:   <clock offset="utc">
Aug 17 09:02:57 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 09:02:57 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 09:02:57 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 09:02:57 user nova-compute[72998]:   </clock>
Aug 17 09:02:57 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 09:02:57 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 09:02:57 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 09:02:57 user nova-compute[72998]:   </cpu>
Aug 17 09:02:57 user nova-compute[72998]:   <devices>
Aug 17 09:02:57 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 09:02:57 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:02:57 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 09:02:57 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 09:02:57 user nova-compute[72998]:       <serial>2855e4d0-e1b4-4f05-9516-b9b528b15d14</serial>
Aug 17 09:02:57 user nova-compute[72998]:     </disk>
Aug 17 09:02:57 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 09:02:57 user nova-compute[72998]:       <mac address="fa:16:3e:0f:7d:1b"/>
Aug 17 09:02:57 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:02:57 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 09:02:57 user nova-compute[72998]:       <target dev="tap8281f63a-3e"/>
Aug 17 09:02:57 user nova-compute[72998]:     </interface>
Aug 17 09:02:57 user nova-compute[72998]:     <serial type="pty">
Aug 17 09:02:57 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/c00f2167-19cf-4ca0-8604-3dac17215b8d/console.log" append="off"/>
Aug 17 09:02:57 user nova-compute[72998]:     </serial>
Aug 17 09:02:57 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 09:02:57 user nova-compute[72998]:     <video>
Aug 17 09:02:57 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:02:57 user nova-compute[72998]:     </video>
Aug 17 09:02:57 user nova-compute[72998]:     <rng model="virtio">
Aug 17 09:02:57 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 09:02:57 user nova-compute[72998]:     </rng>
Aug 17 09:02:57 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 09:02:57 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 09:02:57 user nova-compute[72998]:       <stats period="10"/>
Aug 17 09:02:57 user nova-compute[72998]:     </memballoon>
Aug 17 09:02:57 user nova-compute[72998]:   </devices>
Aug 17 09:02:57 user nova-compute[72998]: </domain>
Aug 17 09:02:57 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1756852222',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1756852222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1756852222',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYvL2xIqYuv8w9IwkFvU+ZcMJFc4NdSGWZu2nOjGBKMWQ2RyI0+Dh3xTAZWR7lEklTNusDs7HrmkiAJ0H3ag3Ic9WiZv4kxXCjXyPTYVZHWVJLA0zwvyfinAwVr4Uyvag==',key_name='tempest-keypair-1765114348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-fvcbjdvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=c00f2167-19cf-4ca0-8604-3dac17215b8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=8281f63a-3e49-4bac-8830-6af5b8518ec7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8281f63a-3e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG os_vif [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=8281f63a-3e49-4bac-8830-6af5b8518ec7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8281f63a-3e') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8281f63a-3e, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8281f63a-3e, col_values=(('external_ids', {'iface-id': '8281f63a-3e49-4bac-8830-6af5b8518ec7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:7d:1b', 'vm-uuid': 'c00f2167-19cf-4ca0-8604-3dac17215b8d'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:57 user nova-compute[72998]: INFO os_vif [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=8281f63a-3e49-4bac-8830-6af5b8518ec7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8281f63a-3e')
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:02:57 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No VIF found with MAC fa:16:3e:0f:7d:1b, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:02:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-3684def8-3eb9-4427-a537-7442ee8acc2a req-b74cb67c-04fc-4999-82b1-35c7e3dbffd7 service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received event network-vif-plugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:02:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3684def8-3eb9-4427-a537-7442ee8acc2a req-b74cb67c-04fc-4999-82b1-35c7e3dbffd7 service nova] Acquiring lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:02:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3684def8-3eb9-4427-a537-7442ee8acc2a req-b74cb67c-04fc-4999-82b1-35c7e3dbffd7 service nova] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:02:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3684def8-3eb9-4427-a537-7442ee8acc2a req-b74cb67c-04fc-4999-82b1-35c7e3dbffd7 service nova] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:02:58 user nova-compute[72998]: DEBUG nova.compute.manager [req-3684def8-3eb9-4427-a537-7442ee8acc2a req-b74cb67c-04fc-4999-82b1-35c7e3dbffd7 service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] No waiting events found dispatching network-vif-plugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:02:58 user nova-compute[72998]: WARNING nova.compute.manager [req-3684def8-3eb9-4427-a537-7442ee8acc2a req-b74cb67c-04fc-4999-82b1-35c7e3dbffd7 service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received unexpected event network-vif-plugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 for instance with vm_state building and task_state spawning.
Aug 17 09:02:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:02:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262980.61693, c00f2167-19cf-4ca0-8604-3dac17215b8d => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:03:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] VM Resumed (Lifecycle Event)
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 09:03:00 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Instance spawned successfully.
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:03:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692262980.6200573, c00f2167-19cf-4ca0-8604-3dac17215b8d => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:03:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] VM Started (Lifecycle Event)
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:03:00 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:03:00 user nova-compute[72998]: INFO nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-7adcd78e-89fa-4a02-b58d-4ac3398c8664 req-e5ed0eef-2887-4b8b-835e-92d68371968e service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received event network-vif-plugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7adcd78e-89fa-4a02-b58d-4ac3398c8664 req-e5ed0eef-2887-4b8b-835e-92d68371968e service nova] Acquiring lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7adcd78e-89fa-4a02-b58d-4ac3398c8664 req-e5ed0eef-2887-4b8b-835e-92d68371968e service nova] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7adcd78e-89fa-4a02-b58d-4ac3398c8664 req-e5ed0eef-2887-4b8b-835e-92d68371968e service nova] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:03:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-7adcd78e-89fa-4a02-b58d-4ac3398c8664 req-e5ed0eef-2887-4b8b-835e-92d68371968e service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] No waiting events found dispatching network-vif-plugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:03:00 user nova-compute[72998]: WARNING nova.compute.manager [req-7adcd78e-89fa-4a02-b58d-4ac3398c8664 req-e5ed0eef-2887-4b8b-835e-92d68371968e service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received unexpected event network-vif-plugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 for instance with vm_state active and task_state None.
Aug 17 09:03:00 user nova-compute[72998]: INFO nova.compute.manager [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Took 15.83 seconds to build instance.
Aug 17 09:03:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-a1b15aaa-202c-4ce4-ae89-c19fd81be4c7 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.914s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:03:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:03:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:03:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:03:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:03:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:03:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:03:28 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:03:28 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c00f2167-19cf-4ca0-8604-3dac17215b8d {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:03:29 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updating instance_info_cache with network_info: [{"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:03:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:03:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:03:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:03:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:03:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:03:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:03:43 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:03:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:03:44 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:03:44 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:03:44 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=24.07543182373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:03:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:03:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:03:44 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c00f2167-19cf-4ca0-8604-3dac17215b8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:03:44 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:03:44 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:03:44 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:03:44 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:03:44 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:03:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:03:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:03:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:47 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:03:50 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:03:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:03:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:03:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:03:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:03:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:04:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:04:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:04:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:04:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:04:28 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:04:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:04:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:04:29 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:04:29 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c00f2167-19cf-4ca0-8604-3dac17215b8d {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:04:29 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updating instance_info_cache with network_info: [{"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:04:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:04:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:04:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:04:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-35c5dec6-4555-4b28-a382-649c9f52c32c req-4dee5a41-3166-4422-acc1-8c4472099fcc service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received event network-changed-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:04:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-35c5dec6-4555-4b28-a382-649c9f52c32c req-4dee5a41-3166-4422-acc1-8c4472099fcc service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Refreshing instance network info cache due to event network-changed-8281f63a-3e49-4bac-8830-6af5b8518ec7. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:04:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-35c5dec6-4555-4b28-a382-649c9f52c32c req-4dee5a41-3166-4422-acc1-8c4472099fcc service nova] Acquiring lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:04:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-35c5dec6-4555-4b28-a382-649c9f52c32c req-4dee5a41-3166-4422-acc1-8c4472099fcc service nova] Acquired lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:04:36 user nova-compute[72998]: DEBUG nova.network.neutron [req-35c5dec6-4555-4b28-a382-649c9f52c32c req-4dee5a41-3166-4422-acc1-8c4472099fcc service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Refreshing network info cache for port 8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:04:36 user nova-compute[72998]: DEBUG nova.network.neutron [req-35c5dec6-4555-4b28-a382-649c9f52c32c req-4dee5a41-3166-4422-acc1-8c4472099fcc service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updated VIF entry in instance network info cache for port 8281f63a-3e49-4bac-8830-6af5b8518ec7. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:04:36 user nova-compute[72998]: DEBUG nova.network.neutron [req-35c5dec6-4555-4b28-a382-649c9f52c32c req-4dee5a41-3166-4422-acc1-8c4472099fcc service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updating instance_info_cache with network_info: [{"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:04:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-35c5dec6-4555-4b28-a382-649c9f52c32c req-4dee5a41-3166-4422-acc1-8c4472099fcc service nova] Releasing lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:04:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:04:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:04:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:04:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:45 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:04:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:04:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:04:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:04:45 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:04:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:04:46 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:04:46 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:04:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=24.074565887451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c00f2167-19cf-4ca0-8604-3dac17215b8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:04:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "5d84abe3-1df7-480b-a121-0649a892f030" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:04:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "5d84abe3-1df7-480b-a121-0649a892f030" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:04:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 09:04:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:04:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:04:47 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 09:04:47 user nova-compute[72998]: INFO nova.compute.claims [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Claim successful on node user
Aug 17 09:04:48 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:04:48 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:04:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:04:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 09:04:48 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 09:04:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 09:04:48 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 09:04:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 09:04:48 user nova-compute[72998]: INFO nova.virt.block_device [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Booting with volume snapshot a892aeac-de67-4625-811d-0e545fc8d4d7 at /dev/vda
Aug 17 09:04:48 user nova-compute[72998]: DEBUG nova.policy [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeab5ccaa12540cf950a9461460cb6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e261c30b0a34357895224cf4772b371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 09:04:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:04:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Successfully created port: 350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 09:04:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Successfully updated port: 350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 09:04:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:04:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquired lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:04:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 09:04:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 09:04:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-f7cc6d51-6a00-447e-abdb-52a19ce036dd req-4940d445-96e9-4c76-8c5f-e9e81dfcce2f service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received event network-changed-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:04:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-f7cc6d51-6a00-447e-abdb-52a19ce036dd req-4940d445-96e9-4c76-8c5f-e9e81dfcce2f service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Refreshing instance network info cache due to event network-changed-350f9ff7-13d1-4a9d-a13a-341735f5b856. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:04:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7cc6d51-6a00-447e-abdb-52a19ce036dd req-4940d445-96e9-4c76-8c5f-e9e81dfcce2f service nova] Acquiring lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Updating instance_info_cache with network_info: [{"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Releasing lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Instance network_info: |[{"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7cc6d51-6a00-447e-abdb-52a19ce036dd req-4940d445-96e9-4c76-8c5f-e9e81dfcce2f service nova] Acquired lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-f7cc6d51-6a00-447e-abdb-52a19ce036dd req-4940d445-96e9-4c76-8c5f-e9e81dfcce2f service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Refreshing network info cache for port 350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-f7cc6d51-6a00-447e-abdb-52a19ce036dd req-4940d445-96e9-4c76-8c5f-e9e81dfcce2f service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Updated VIF entry in instance network info cache for port 350f9ff7-13d1-4a9d-a13a-341735f5b856. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-f7cc6d51-6a00-447e-abdb-52a19ce036dd req-4940d445-96e9-4c76-8c5f-e9e81dfcce2f service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Updating instance_info_cache with network_info: [{"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f7cc6d51-6a00-447e-abdb-52a19ce036dd req-4940d445-96e9-4c76-8c5f-e9e81dfcce2f service nova] Releasing lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:04:50 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:04:51 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:04:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG os_brick.utils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[180a7e8b-cfba-49c4-ae71-97525889f5c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c8db59-a22f-408b-974d-611b6ae48c7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a800fc-7c3b-42fd-a1ba-32454c724f43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b807a527-f38f-47cb-aa9c-9e227bdcf562]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:04:54 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f4bd26-f4e2-4e50-abcd-99b2e0f837c1]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG os_brick.utils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Updating existing volume attachment record: cc3efd59-7764-421b-8fa2-c0a46d9a8bbb {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:04:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:04:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:04:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:04:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:04:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:04:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 09:05:04 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Creating image(s)
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Ensure instance console log exists: /opt/stack/data/nova/instances/5d84abe3-1df7-480b-a121-0649a892f030/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Start _get_guest_xml network_info=[{"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T09:04:38Z,direct_url=<?>,disk_format='qcow2',id=48c46141-2fc7-40db-ae03-21f7bb2c0630,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-514125474',owner='3e261c30b0a34357895224cf4772b371',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T09:04:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cc3efd59-7764-421b-8fa2-c0a46d9a8bbb', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJLjavUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d84abe3-1df7-480b-a121-0649a892f030', 'attached_at': '', 'detached_at': '', 'volume_id': '85158c61-32d3-437e-9777-9f06f39013dd', 'serial': '85158c61-32d3-437e-9777-9f06f39013dd'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 09:05:04 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:05:04 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T09:04:38Z,direct_url=<?>,disk_format='qcow2',id=48c46141-2fc7-40db-ae03-21f7bb2c0630,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-514125474',owner='3e261c30b0a34357895224cf4772b371',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T09:04:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJLjavUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:05:04 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:05:04 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:05:04 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99f38d2-d074-41d2-9fbc-522237da2498]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:05:04 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d185765-edcf-473b-b0bc-3fde1ae6d26e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd] added
Aug 17 09:05:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f807abb-03e3-402a-9c21-65676859b659]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a8d120-94eb-4658-99b9-b6de00a80e82]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJLjavUR {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OJLjavUR" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d7c125-3245-4f0f-85df-e37947fc5bc0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OJLjavUR'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d2b424-06ef-498b-8b23-0219376134b7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d761be6-216e-457d-ab60-81a55b3b4364]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:05:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:05:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf7029e-9179-4e49-9733-841803305472]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd, portal: 172.16.0.220,3260]
Aug 17 09:05:04 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd, portal: 172.16.0.220,3260] successful.
Aug 17 09:05:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbefb09-e26a-4604-977e-729d92b9c7f0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419b258-a9d9-4a80-9923-381b8121cad1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:05:04 user nova-compute[72998]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd (non-flash)
Aug 17 09:05:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:05:04 user nova-compute[72998]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd (non-flash)
Aug 17 09:05:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bf34a9-9ff5-474d-b144-c56dc93c3f65]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:05:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJLjavUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26161663134343235', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161663134343235', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1295766841',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1295766841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1295766841',id=48,image_ref='48c46141-2fc7-40db-ae03-21f7bb2c0630',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAsnZAO+JGs2oB2yzLNpfTzHMQ0C3mr1pTry4yt43cXeOGc902XQ/cskN/iQ7VQo4Jx/7q3+xH6xYbIcQnwKCSWNbtJk1bMF0H4zNuGx9BlriY9S0J9OpQVkj3DbqhLeQ==',key_name='tempest-keypair-957428914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-ozqs46u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-496980120',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=5d84abe3-1df7-480b-a121-0649a892f030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=350f9ff7-13d1-4a9d-a13a-341735f5b856,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f9ff7-13') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d84abe3-1df7-480b-a121-0649a892f030 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] End _get_guest_xml xml=<domain type="kvm">
Aug 17 09:05:05 user nova-compute[72998]:   <uuid>5d84abe3-1df7-480b-a121-0649a892f030</uuid>
Aug 17 09:05:05 user nova-compute[72998]:   <name>instance-00000030</name>
Aug 17 09:05:05 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 09:05:05 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 09:05:05 user nova-compute[72998]:   <metadata>
Aug 17 09:05:05 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 09:05:05 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 09:05:05 user nova-compute[72998]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1295766841</nova:name>
Aug 17 09:05:05 user nova-compute[72998]:       <nova:creationTime>2023-08-17 09:05:04</nova:creationTime>
Aug 17 09:05:05 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 09:05:05 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 09:05:05 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 09:05:05 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 09:05:05 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 09:05:05 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 09:05:05 user nova-compute[72998]:       </nova:flavor>
Aug 17 09:05:05 user nova-compute[72998]:       <nova:owner>
Aug 17 09:05:05 user nova-compute[72998]:         <nova:user uuid="eeab5ccaa12540cf950a9461460cb6ae">tempest-TestVolumeBootPattern-496980120-project-member</nova:user>
Aug 17 09:05:05 user nova-compute[72998]:         <nova:project uuid="3e261c30b0a34357895224cf4772b371">tempest-TestVolumeBootPattern-496980120</nova:project>
Aug 17 09:05:05 user nova-compute[72998]:       </nova:owner>
Aug 17 09:05:05 user nova-compute[72998]:       <nova:root type="image" uuid="48c46141-2fc7-40db-ae03-21f7bb2c0630"/>
Aug 17 09:05:05 user nova-compute[72998]:       <nova:ports>
Aug 17 09:05:05 user nova-compute[72998]:         <nova:port uuid="350f9ff7-13d1-4a9d-a13a-341735f5b856">
Aug 17 09:05:05 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 09:05:05 user nova-compute[72998]:         </nova:port>
Aug 17 09:05:05 user nova-compute[72998]:       </nova:ports>
Aug 17 09:05:05 user nova-compute[72998]:     </nova:instance>
Aug 17 09:05:05 user nova-compute[72998]:   </metadata>
Aug 17 09:05:05 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 09:05:05 user nova-compute[72998]:     <system>
Aug 17 09:05:05 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 09:05:05 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 09:05:05 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 09:05:05 user nova-compute[72998]:       <entry name="serial">5d84abe3-1df7-480b-a121-0649a892f030</entry>
Aug 17 09:05:05 user nova-compute[72998]:       <entry name="uuid">5d84abe3-1df7-480b-a121-0649a892f030</entry>
Aug 17 09:05:05 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 09:05:05 user nova-compute[72998]:     </system>
Aug 17 09:05:05 user nova-compute[72998]:   </sysinfo>
Aug 17 09:05:05 user nova-compute[72998]:   <os>
Aug 17 09:05:05 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 09:05:05 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 09:05:05 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 09:05:05 user nova-compute[72998]:   </os>
Aug 17 09:05:05 user nova-compute[72998]:   <features>
Aug 17 09:05:05 user nova-compute[72998]:     <acpi/>
Aug 17 09:05:05 user nova-compute[72998]:     <apic/>
Aug 17 09:05:05 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 09:05:05 user nova-compute[72998]:   </features>
Aug 17 09:05:05 user nova-compute[72998]:   <clock offset="utc">
Aug 17 09:05:05 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 09:05:05 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 09:05:05 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 09:05:05 user nova-compute[72998]:   </clock>
Aug 17 09:05:05 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 09:05:05 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 09:05:05 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 09:05:05 user nova-compute[72998]:   </cpu>
Aug 17 09:05:05 user nova-compute[72998]:   <devices>
Aug 17 09:05:05 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 09:05:05 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:05:05 user nova-compute[72998]:       <source dev="/dev/sdc"/>
Aug 17 09:05:05 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 09:05:05 user nova-compute[72998]:       <serial>85158c61-32d3-437e-9777-9f06f39013dd</serial>
Aug 17 09:05:05 user nova-compute[72998]:     </disk>
Aug 17 09:05:05 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 09:05:05 user nova-compute[72998]:       <mac address="fa:16:3e:6f:ff:75"/>
Aug 17 09:05:05 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:05:05 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 09:05:05 user nova-compute[72998]:       <target dev="tap350f9ff7-13"/>
Aug 17 09:05:05 user nova-compute[72998]:     </interface>
Aug 17 09:05:05 user nova-compute[72998]:     <serial type="pty">
Aug 17 09:05:05 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/5d84abe3-1df7-480b-a121-0649a892f030/console.log" append="off"/>
Aug 17 09:05:05 user nova-compute[72998]:     </serial>
Aug 17 09:05:05 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 09:05:05 user nova-compute[72998]:     <video>
Aug 17 09:05:05 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:05:05 user nova-compute[72998]:     </video>
Aug 17 09:05:05 user nova-compute[72998]:     <rng model="virtio">
Aug 17 09:05:05 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 09:05:05 user nova-compute[72998]:     </rng>
Aug 17 09:05:05 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 09:05:05 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 09:05:05 user nova-compute[72998]:       <stats period="10"/>
Aug 17 09:05:05 user nova-compute[72998]:     </memballoon>
Aug 17 09:05:05 user nova-compute[72998]:   </devices>
Aug 17 09:05:05 user nova-compute[72998]: </domain>
Aug 17 09:05:05 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1295766841',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1295766841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1295766841',id=48,image_ref='48c46141-2fc7-40db-ae03-21f7bb2c0630',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAsnZAO+JGs2oB2yzLNpfTzHMQ0C3mr1pTry4yt43cXeOGc902XQ/cskN/iQ7VQo4Jx/7q3+xH6xYbIcQnwKCSWNbtJk1bMF0H4zNuGx9BlriY9S0J9OpQVkj3DbqhLeQ==',key_name='tempest-keypair-957428914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-ozqs46u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-496980120',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=5d84abe3-1df7-480b-a121-0649a892f030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=350f9ff7-13d1-4a9d-a13a-341735f5b856,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f9ff7-13') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG os_vif [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=350f9ff7-13d1-4a9d-a13a-341735f5b856,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f9ff7-13') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap350f9ff7-13, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap350f9ff7-13, col_values=(('external_ids', {'iface-id': '350f9ff7-13d1-4a9d-a13a-341735f5b856', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:ff:75', 'vm-uuid': '5d84abe3-1df7-480b-a121-0649a892f030'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:05 user nova-compute[72998]: INFO os_vif [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=350f9ff7-13d1-4a9d-a13a-341735f5b856,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f9ff7-13')
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:05:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No VIF found with MAC fa:16:3e:6f:ff:75, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:05:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:07 user nova-compute[72998]: DEBUG nova.compute.manager [req-6a372a39-0c3d-428d-99f7-4d4541af01fb req-c822f372-679c-4e49-aa0d-44b0c4bac6ae service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received event network-vif-plugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:05:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6a372a39-0c3d-428d-99f7-4d4541af01fb req-c822f372-679c-4e49-aa0d-44b0c4bac6ae service nova] Acquiring lock "5d84abe3-1df7-480b-a121-0649a892f030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:05:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6a372a39-0c3d-428d-99f7-4d4541af01fb req-c822f372-679c-4e49-aa0d-44b0c4bac6ae service nova] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:05:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6a372a39-0c3d-428d-99f7-4d4541af01fb req-c822f372-679c-4e49-aa0d-44b0c4bac6ae service nova] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:05:07 user nova-compute[72998]: DEBUG nova.compute.manager [req-6a372a39-0c3d-428d-99f7-4d4541af01fb req-c822f372-679c-4e49-aa0d-44b0c4bac6ae service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] No waiting events found dispatching network-vif-plugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:05:07 user nova-compute[72998]: WARNING nova.compute.manager [req-6a372a39-0c3d-428d-99f7-4d4541af01fb req-c822f372-679c-4e49-aa0d-44b0c4bac6ae service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received unexpected event network-vif-plugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 for instance with vm_state building and task_state spawning.
Aug 17 09:05:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263109.1774817, 5d84abe3-1df7-480b-a121-0649a892f030 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:05:09 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] VM Resumed (Lifecycle Event)
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 09:05:09 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Instance spawned successfully.
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:05:09 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263109.1808407, 5d84abe3-1df7-480b-a121-0649a892f030 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:05:09 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] VM Started (Lifecycle Event)
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:05:09 user nova-compute[72998]: INFO nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Took 4.85 seconds to spawn the instance on the hypervisor.
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:05:09 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:05:09 user nova-compute[72998]: INFO nova.compute.manager [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Took 21.49 seconds to build instance.
Aug 17 09:05:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4352ffcd-9b15-499d-bfec-cd0d97e948d8 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "5d84abe3-1df7-480b-a121-0649a892f030" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.588s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-9bad8380-30e2-4b6b-aa83-5dc0ffd72670 req-f35f3bc0-4307-4961-9e4d-963371722821 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received event network-vif-plugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9bad8380-30e2-4b6b-aa83-5dc0ffd72670 req-f35f3bc0-4307-4961-9e4d-963371722821 service nova] Acquiring lock "5d84abe3-1df7-480b-a121-0649a892f030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9bad8380-30e2-4b6b-aa83-5dc0ffd72670 req-f35f3bc0-4307-4961-9e4d-963371722821 service nova] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9bad8380-30e2-4b6b-aa83-5dc0ffd72670 req-f35f3bc0-4307-4961-9e4d-963371722821 service nova] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:05:09 user nova-compute[72998]: DEBUG nova.compute.manager [req-9bad8380-30e2-4b6b-aa83-5dc0ffd72670 req-f35f3bc0-4307-4961-9e4d-963371722821 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] No waiting events found dispatching network-vif-plugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:05:09 user nova-compute[72998]: WARNING nova.compute.manager [req-9bad8380-30e2-4b6b-aa83-5dc0ffd72670 req-f35f3bc0-4307-4961-9e4d-963371722821 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received unexpected event network-vif-plugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 for instance with vm_state active and task_state None.
Aug 17 09:05:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:05:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:30 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:05:30 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:05:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:05:30 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:05:30 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:05:30 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c00f2167-19cf-4ca0-8604-3dac17215b8d {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:05:31 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updating instance_info_cache with network_info: [{"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:05:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:05:31 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:05:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:45 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:45 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:05:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:05:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:05:45 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:05:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:05:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:05:46 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:05:46 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=24.07276153564453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c00f2167-19cf-4ca0-8604-3dac17215b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance 5d84abe3-1df7-480b-a121-0649a892f030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:05:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:05:50 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:05:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 09:05:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:05:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:05:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:05:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:05:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:05:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:05:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:06:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 09:06:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 09:06:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:06:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:06:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:06:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:06:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:06:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:06:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:06:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:06:32 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:06:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:06:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:06:32 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:06:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Updating instance_info_cache with network_info: [{"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:06:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:06:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:06:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-79c42914-69aa-4aef-bd17-9a82451aa911 req-7843ab1e-edbf-4d4b-843f-8c247be9f123 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received event network-changed-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:06:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-79c42914-69aa-4aef-bd17-9a82451aa911 req-7843ab1e-edbf-4d4b-843f-8c247be9f123 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Refreshing instance network info cache due to event network-changed-350f9ff7-13d1-4a9d-a13a-341735f5b856. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:06:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-79c42914-69aa-4aef-bd17-9a82451aa911 req-7843ab1e-edbf-4d4b-843f-8c247be9f123 service nova] Acquiring lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:06:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-79c42914-69aa-4aef-bd17-9a82451aa911 req-7843ab1e-edbf-4d4b-843f-8c247be9f123 service nova] Acquired lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:06:38 user nova-compute[72998]: DEBUG nova.network.neutron [req-79c42914-69aa-4aef-bd17-9a82451aa911 req-7843ab1e-edbf-4d4b-843f-8c247be9f123 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Refreshing network info cache for port 350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-79c42914-69aa-4aef-bd17-9a82451aa911 req-7843ab1e-edbf-4d4b-843f-8c247be9f123 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Updated VIF entry in instance network info cache for port 350f9ff7-13d1-4a9d-a13a-341735f5b856. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG nova.network.neutron [req-79c42914-69aa-4aef-bd17-9a82451aa911 req-7843ab1e-edbf-4d4b-843f-8c247be9f123 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Updating instance_info_cache with network_info: [{"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-79c42914-69aa-4aef-bd17-9a82451aa911 req-7843ab1e-edbf-4d4b-843f-8c247be9f123 service nova] Releasing lock "refresh_cache-5d84abe3-1df7-480b-a121-0649a892f030" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "5d84abe3-1df7-480b-a121-0649a892f030" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "5d84abe3-1df7-480b-a121-0649a892f030" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "5d84abe3-1df7-480b-a121-0649a892f030-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:06:39 user nova-compute[72998]: INFO nova.compute.manager [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Terminating instance
Aug 17 09:06:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Instance destroyed successfully.
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.objects.instance [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'resources' on Instance uuid 5d84abe3-1df7-480b-a121-0649a892f030 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1295766841',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1295766841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1295766841',id=48,image_ref='48c46141-2fc7-40db-ae03-21f7bb2c0630',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAsnZAO+JGs2oB2yzLNpfTzHMQ0C3mr1pTry4yt43cXeOGc902XQ/cskN/iQ7VQo4Jx/7q3+xH6xYbIcQnwKCSWNbtJk1bMF0H4zNuGx9BlriY9S0J9OpQVkj3DbqhLeQ==',key_name='tempest-keypair-957428914',keypairs=<?>,launch_index=0,launched_at=2023-08-17T09:05:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-ozqs46u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-496980120',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T09:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=5d84abe3-1df7-480b-a121-0649a892f030,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "address": "fa:16:3e:6f:ff:75", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f9ff7-13", "ovs_interfaceid": "350f9ff7-13d1-4a9d-a13a-341735f5b856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=350f9ff7-13d1-4a9d-a13a-341735f5b856,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f9ff7-13') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_vif [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=350f9ff7-13d1-4a9d-a13a-341735f5b856,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f9ff7-13') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap350f9ff7-13, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:06:40 user nova-compute[72998]: INFO os_vif [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:ff:75,bridge_name='br-int',has_traffic_filtering=True,id=350f9ff7-13d1-4a9d-a13a-341735f5b856,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f9ff7-13')
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OJLjavUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:06:40 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[925f0c14-3151-4c27-b3a8-b4e327559c14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0498ef-9c10-483f-8a40-b54b2cab7ba7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:06:40 user nova-compute[72998]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd (non-flash)
Aug 17 09:06:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:06:40 user nova-compute[72998]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd (non-flash)
Aug 17 09:06:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464bfeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3d19b8-0a18-4913-8f0c-12512be8afd9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa2e0d6-04ad-415e-87fa-73a43dd1dc74]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb94be8-c6fa-41bc-8b99-7a43c1f77661]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0355aaa9-8c9f-46cd-af8f-639a5a0dd0f1]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c1e951-b119-49eb-b0fb-de0fd2d22d9e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a83c58e-358d-4975-accf-7b2184742f18]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd, portal: 172.16.0.220,3260]
Aug 17 09:06:40 user nova-compute[72998]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd, portal: 172.16.0.220,3260] successful.
Aug 17 09:06:40 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85158c61-32d3-437e-9777-9f06f39013dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[813928f2-abae-4345-b59a-dd2f3b89a7d7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== disconnect_volume: return (295ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:06:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Deleting instance files /opt/stack/data/nova/instances/5d84abe3-1df7-480b-a121-0649a892f030_del
Aug 17 09:06:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Deletion of /opt/stack/data/nova/instances/5d84abe3-1df7-480b-a121-0649a892f030_del complete
Aug 17 09:06:40 user nova-compute[72998]: INFO nova.compute.manager [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received event network-vif-unplugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] Acquiring lock "5d84abe3-1df7-480b-a121-0649a892f030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] No waiting events found dispatching network-vif-unplugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received event network-vif-unplugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received event network-vif-plugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] Acquiring lock "5d84abe3-1df7-480b-a121-0649a892f030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] Lock "5d84abe3-1df7-480b-a121-0649a892f030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:06:40 user nova-compute[72998]: DEBUG nova.compute.manager [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] No waiting events found dispatching network-vif-plugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:06:40 user nova-compute[72998]: WARNING nova.compute.manager [req-32dcb2db-af3c-4615-a94e-94c6f7009e61 req-a8e7cbbe-1241-4d65-ae59-40de1bad8639 service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received unexpected event network-vif-plugged-350f9ff7-13d1-4a9d-a13a-341735f5b856 for instance with vm_state active and task_state deleting.
Aug 17 09:06:41 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:06:41 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Took 0.72 seconds to deallocate network for instance.
Aug 17 09:06:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:41 user nova-compute[72998]: INFO nova.compute.manager [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 09:06:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Deleting volume: 85158c61-32d3-437e-9777-9f06f39013dd {{(pid=72998) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 09:06:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:06:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:06:42 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:06:42 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:06:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:06:42 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Deleted allocations for instance 5d84abe3-1df7-480b-a121-0649a892f030
Aug 17 09:06:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da84b248-380d-4ad7-bff5-0aa4d9c616d0 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "5d84abe3-1df7-480b-a121-0649a892f030" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.087s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:06:43 user nova-compute[72998]: DEBUG nova.compute.manager [req-069f1f0f-fa92-461b-a8a4-8ed69cce7c81 req-87b7d6fb-0bb7-4155-bc9d-a95326892d9d service nova] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Received event network-vif-deleted-350f9ff7-13d1-4a9d-a13a-341735f5b856 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:06:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:45 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:06:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:06:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:06:46 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:06:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:06:47 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:06:47 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:06:47 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=24.071903228759766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:06:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:06:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:06:47 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c00f2167-19cf-4ca0-8604-3dac17215b8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:06:47 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:06:47 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:06:47 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:06:47 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:06:47 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:06:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:06:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:06:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:06:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:06:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:06:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:06:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:06:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:06:55 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692263200.0709023, 5d84abe3-1df7-480b-a121-0649a892f030 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:06:55 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] VM Stopped (Lifecycle Event)
Aug 17 09:06:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-41d3bbc6-d741-484e-befd-99193a2de364 None None] [instance: 5d84abe3-1df7-480b-a121-0649a892f030] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:06:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:06:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:07:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:33 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:07:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:07:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:07:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:07:33 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:07:33 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c00f2167-19cf-4ca0-8604-3dac17215b8d {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:07:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updating instance_info_cache with network_info: [{"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:07:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c00f2167-19cf-4ca0-8604-3dac17215b8d" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:07:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:07:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "c00f2167-19cf-4ca0-8604-3dac17215b8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:07:36 user nova-compute[72998]: INFO nova.compute.manager [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Terminating instance
Aug 17 09:07:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-e6c57d80-c3ff-4262-a5c8-34d22b7d8806 req-cbb3c762-2de4-4f18-bb92-b2dd5d74deda service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received event network-vif-unplugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e6c57d80-c3ff-4262-a5c8-34d22b7d8806 req-cbb3c762-2de4-4f18-bb92-b2dd5d74deda service nova] Acquiring lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e6c57d80-c3ff-4262-a5c8-34d22b7d8806 req-cbb3c762-2de4-4f18-bb92-b2dd5d74deda service nova] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e6c57d80-c3ff-4262-a5c8-34d22b7d8806 req-cbb3c762-2de4-4f18-bb92-b2dd5d74deda service nova] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-e6c57d80-c3ff-4262-a5c8-34d22b7d8806 req-cbb3c762-2de4-4f18-bb92-b2dd5d74deda service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] No waiting events found dispatching network-vif-unplugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG nova.compute.manager [req-e6c57d80-c3ff-4262-a5c8-34d22b7d8806 req-cbb3c762-2de4-4f18-bb92-b2dd5d74deda service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received event network-vif-unplugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 09:07:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Instance destroyed successfully.
Aug 17 09:07:36 user nova-compute[72998]: DEBUG nova.objects.instance [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'resources' on Instance uuid c00f2167-19cf-4ca0-8604-3dac17215b8d {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1756852222',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1756852222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1756852222',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYvL2xIqYuv8w9IwkFvU+ZcMJFc4NdSGWZu2nOjGBKMWQ2RyI0+Dh3xTAZWR7lEklTNusDs7HrmkiAJ0H3ag3Ic9WiZv4kxXCjXyPTYVZHWVJLA0zwvyfinAwVr4Uyvag==',key_name='tempest-keypair-1765114348',keypairs=<?>,launch_index=0,launched_at=2023-08-17T09:03:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-fvcbjdvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T09:03:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=c00f2167-19cf-4ca0-8604-3dac17215b8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "address": "fa:16:3e:0f:7d:1b", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8281f63a-3e", "ovs_interfaceid": "8281f63a-3e49-4bac-8830-6af5b8518ec7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=8281f63a-3e49-4bac-8830-6af5b8518ec7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8281f63a-3e') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG os_vif [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=8281f63a-3e49-4bac-8830-6af5b8518ec7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8281f63a-3e') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8281f63a-3e, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:36 user nova-compute[72998]: INFO os_vif [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:7d:1b,bridge_name='br-int',has_traffic_filtering=True,id=8281f63a-3e49-4bac-8830-6af5b8518ec7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8281f63a-3e')
Aug 17 09:07:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZxfmGwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:07:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:07:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff62d9a3-74f4-461e-ae30-833ad0997d5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[733bd6d1-7bae-49fc-ab34-3ac1ca15c2c1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:07:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 (non-flash)
Aug 17 09:07:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464b9c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ffff67-c5c6-417c-9bf2-f969be5488a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed29aa9-0e6a-472d-97fa-47e93d40e2c0]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fade054-3723-4a6e-803c-6435c6f746c0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1729fa28-c0fd-42b5-9362-db518fb1dfb7]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8a66e39b', '/dev/disk/by-id/scsi-23130643338636364', '/dev/disk/by-id/scsi-1SCST_BIO8a66e39b-10d38ccde7b192df') {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[68523d37-cda8-42c0-a06a-8200b60c65bf]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bfd6af-db45-4656-86ef-6909737e6e08]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca9b7c-9dd1-4a43-b453-db03a8805a91]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14, portal: 172.16.0.220,3260]
Aug 17 09:07:37 user nova-compute[72998]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14, portal: 172.16.0.220,3260] successful.
Aug 17 09:07:37 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2855e4d0-e1b4-4f05-9516-b9b528b15d14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56da4fd-53a6-4c32-bc75-61e8c2cd107d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== disconnect_volume: return (281ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:07:37 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Deleting instance files /opt/stack/data/nova/instances/c00f2167-19cf-4ca0-8604-3dac17215b8d_del
Aug 17 09:07:37 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Deletion of /opt/stack/data/nova/instances/c00f2167-19cf-4ca0-8604-3dac17215b8d_del complete
Aug 17 09:07:37 user nova-compute[72998]: INFO nova.compute.manager [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 17 09:07:37 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 09:07:37 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 09:07:38 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:07:38 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Took 1.03 seconds to deallocate network for instance.
Aug 17 09:07:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-34de3a45-1850-4659-8187-ac642dccbb71 req-081403bb-cadf-4e26-8727-5680b70fe8c9 service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received event network-vif-plugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:07:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-34de3a45-1850-4659-8187-ac642dccbb71 req-081403bb-cadf-4e26-8727-5680b70fe8c9 service nova] Acquiring lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:07:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-34de3a45-1850-4659-8187-ac642dccbb71 req-081403bb-cadf-4e26-8727-5680b70fe8c9 service nova] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:07:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-34de3a45-1850-4659-8187-ac642dccbb71 req-081403bb-cadf-4e26-8727-5680b70fe8c9 service nova] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:07:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-34de3a45-1850-4659-8187-ac642dccbb71 req-081403bb-cadf-4e26-8727-5680b70fe8c9 service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] No waiting events found dispatching network-vif-plugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:07:38 user nova-compute[72998]: WARNING nova.compute.manager [req-34de3a45-1850-4659-8187-ac642dccbb71 req-081403bb-cadf-4e26-8727-5680b70fe8c9 service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received unexpected event network-vif-plugged-8281f63a-3e49-4bac-8830-6af5b8518ec7 for instance with vm_state active and task_state deleting.
Aug 17 09:07:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-34de3a45-1850-4659-8187-ac642dccbb71 req-081403bb-cadf-4e26-8727-5680b70fe8c9 service nova] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Received event network-vif-deleted-8281f63a-3e49-4bac-8830-6af5b8518ec7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:07:39 user nova-compute[72998]: INFO nova.compute.manager [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Took 0.79 seconds to detach 1 volumes for instance.
Aug 17 09:07:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Deleting volume: 2855e4d0-e1b4-4f05-9516-b9b528b15d14 {{(pid=72998) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 09:07:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:07:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:07:39 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:07:39 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:07:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:07:39 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Deleted allocations for instance c00f2167-19cf-4ca0-8604-3dac17215b8d
Aug 17 09:07:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-fc484324-7034-4de0-bf41-ebe7a34670ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c00f2167-19cf-4ca0-8604-3dac17215b8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.262s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:07:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:45 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:07:47 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:07:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:07:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:07:48 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:07:49 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:07:49 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:07:49 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=24.071048736572266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:07:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:07:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:07:49 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:07:49 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:07:49 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:07:49 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:07:49 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:07:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:07:51 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692263256.8697877, c00f2167-19cf-4ca0-8604-3dac17215b8d => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:07:51 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] VM Stopped (Lifecycle Event)
Aug 17 09:07:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-0dba6268-e298-485b-b474-88641123cf9c None None] [instance: c00f2167-19cf-4ca0-8604-3dac17215b8d] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:07:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:07:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:07:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:07:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:07:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:07:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:52 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:07:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:07:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:08:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:08:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:08:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:08:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:08:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:08:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:08:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:08:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:08:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:08:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 09:08:41 user nova-compute[72998]: INFO nova.compute.claims [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Claim successful on node user
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 09:08:41 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 09:08:41 user nova-compute[72998]: INFO nova.virt.block_device [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Booting with volume a7d15e89-923e-4cb1-a9dd-9bbe3057d21a at /dev/vda
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.policy [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeab5ccaa12540cf950a9461460cb6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e261c30b0a34357895224cf4772b371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG os_brick.utils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa864eea-3f01-4b37-a151-c5e07b613194]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f69f619-85fe-4f40-af63-2674f408b3cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27a0bd-0a2f-4cb6-b0f0-831786c5d8a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f4ec10-330d-423e-a4d5-9263c7589e68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:08:41 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:08:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4c5751-8110-4ab8-9e41-ab25a205a3aa]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG os_brick.utils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Updating existing volume attachment record: 349363c7-f922-415e-9347-ebfe5ea12187 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:41 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Successfully created port: 2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 09:08:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Successfully updated port: 2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 09:08:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:08:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquired lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:08:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 09:08:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-4c0557a4-87a7-434c-a7db-5542005df01a req-f92692a5-d7e0-4697-8692-fc829f583919 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received event network-changed-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:08:42 user nova-compute[72998]: DEBUG nova.compute.manager [req-4c0557a4-87a7-434c-a7db-5542005df01a req-f92692a5-d7e0-4697-8692-fc829f583919 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Refreshing instance network info cache due to event network-changed-2ddf97a7-8674-4360-9cbc-32da6a8e7dba. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:08:42 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4c0557a4-87a7-434c-a7db-5542005df01a req-f92692a5-d7e0-4697-8692-fc829f583919 service nova] Acquiring lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:08:42 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 09:08:43 user nova-compute[72998]: DEBUG nova.network.neutron [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Updating instance_info_cache with network_info: [{"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:08:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Releasing lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:08:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Instance network_info: |[{"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 09:08:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4c0557a4-87a7-434c-a7db-5542005df01a req-f92692a5-d7e0-4697-8692-fc829f583919 service nova] Acquired lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:08:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-4c0557a4-87a7-434c-a7db-5542005df01a req-f92692a5-d7e0-4697-8692-fc829f583919 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Refreshing network info cache for port 2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:08:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-4c0557a4-87a7-434c-a7db-5542005df01a req-f92692a5-d7e0-4697-8692-fc829f583919 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Updated VIF entry in instance network info cache for port 2ddf97a7-8674-4360-9cbc-32da6a8e7dba. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:08:43 user nova-compute[72998]: DEBUG nova.network.neutron [req-4c0557a4-87a7-434c-a7db-5542005df01a req-f92692a5-d7e0-4697-8692-fc829f583919 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Updating instance_info_cache with network_info: [{"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:08:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-4c0557a4-87a7-434c-a7db-5542005df01a req-f92692a5-d7e0-4697-8692-fc829f583919 service nova] Releasing lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:08:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:08:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:08:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:08:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:47 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:08:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:08:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:08:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:08:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:08:48 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:08:49 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:08:49 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:08:49 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=24.061786651611328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:08:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:08:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:08:49 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance b0b337a9-f43b-4f0d-b8b7-93da0496e4a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:08:49 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:08:49 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:08:49 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:08:49 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:08:49 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:08:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 09:08:51 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Creating image(s)
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Ensure instance console log exists: /opt/stack/data/nova/instances/b0b337a9-f43b-4f0d-b8b7-93da0496e4a5/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Start _get_guest_xml network_info=[{"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '349363c7-f922-415e-9347-ebfe5ea12187', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGKychbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0b337a9-f43b-4f0d-b8b7-93da0496e4a5', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7d15e89-923e-4cb1-a9dd-9bbe3057d21a', 'serial': 'a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 09:08:51 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:08:51 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGKychbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:08:51 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:08:51 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:08:51 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8abb2c-bdfe-4a13-bd7f-e78a696ebd47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:08:51 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62f63b1-fc5e-4b87-b2c1-151a8f6f4485]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a] added
Aug 17 09:08:51 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3030d1f5-f871-4aaa-bf8d-9bacae3d66f0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9e6546-fd7d-4ae9-877e-bb2cb627c6c1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGKychbn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGKychbn" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8012b1af-ed5e-4791-ac05-406bcddaf404]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HGKychbn'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcfa9c6-5ea1-4621-adc8-61c679660623]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccbd632-feef-4e83-a897-a5d02aed47eb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:08:51 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:08:51 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:08:51 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:08:51 user nova-compute[72998]: 
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[db78fd9e-399b-4ce0-bd4f-db433b849ec6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260]
Aug 17 09:08:51 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260] successful.
Aug 17 09:08:51 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2a11e8-af8a-4e7f-a683-ea635c928a9f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0a032b-7a0a-4281-9dcf-4de46b38bc18]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:08:51 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:08:51 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1d4f3c-06e3-4e12-a686-4f6e2affffc7]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:08:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGKychbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:08:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:08:52 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23665303162336239', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:08:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665303162336239', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:08:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:08:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1014438104',display_name='tempest-TestVolumeBootPattern-server-1014438104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1014438104',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjTvZgPHFA5zBVDLHwQ6Ik5MpYZKcO/hQ32p5utozUsMbB3Fzp27hH7yFw7YeaiL3gq/7ZnzFRee+WqPWYMFQz72qtVyqekinvIoyNOitgO17CuXEPrxfvfZhU1aFHv1A==',key_name='tempest-TestVolumeBootPattern-347598242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-p5dqx4uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:08:41Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=b0b337a9-f43b-4f0d-b8b7-93da0496e4a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 09:08:52 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:08:52 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:c8:31,bridge_name='br-int',has_traffic_filtering=True,id=2ddf97a7-8674-4360-9cbc-32da6a8e7dba,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddf97a7-86') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:08:52 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'pci_devices' on Instance uuid b0b337a9-f43b-4f0d-b8b7-93da0496e4a5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 09:08:53 user nova-compute[72998]:   <uuid>b0b337a9-f43b-4f0d-b8b7-93da0496e4a5</uuid>
Aug 17 09:08:53 user nova-compute[72998]:   <name>instance-00000031</name>
Aug 17 09:08:53 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 09:08:53 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 09:08:53 user nova-compute[72998]:   <metadata>
Aug 17 09:08:53 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 09:08:53 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 09:08:53 user nova-compute[72998]:       <nova:name>tempest-TestVolumeBootPattern-server-1014438104</nova:name>
Aug 17 09:08:53 user nova-compute[72998]:       <nova:creationTime>2023-08-17 09:08:51</nova:creationTime>
Aug 17 09:08:53 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 09:08:53 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 09:08:53 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 09:08:53 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 09:08:53 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 09:08:53 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 09:08:53 user nova-compute[72998]:       </nova:flavor>
Aug 17 09:08:53 user nova-compute[72998]:       <nova:owner>
Aug 17 09:08:53 user nova-compute[72998]:         <nova:user uuid="eeab5ccaa12540cf950a9461460cb6ae">tempest-TestVolumeBootPattern-496980120-project-member</nova:user>
Aug 17 09:08:53 user nova-compute[72998]:         <nova:project uuid="3e261c30b0a34357895224cf4772b371">tempest-TestVolumeBootPattern-496980120</nova:project>
Aug 17 09:08:53 user nova-compute[72998]:       </nova:owner>
Aug 17 09:08:53 user nova-compute[72998]:       <nova:ports>
Aug 17 09:08:53 user nova-compute[72998]:         <nova:port uuid="2ddf97a7-8674-4360-9cbc-32da6a8e7dba">
Aug 17 09:08:53 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 09:08:53 user nova-compute[72998]:         </nova:port>
Aug 17 09:08:53 user nova-compute[72998]:       </nova:ports>
Aug 17 09:08:53 user nova-compute[72998]:     </nova:instance>
Aug 17 09:08:53 user nova-compute[72998]:   </metadata>
Aug 17 09:08:53 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 09:08:53 user nova-compute[72998]:     <system>
Aug 17 09:08:53 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 09:08:53 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 09:08:53 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 09:08:53 user nova-compute[72998]:       <entry name="serial">b0b337a9-f43b-4f0d-b8b7-93da0496e4a5</entry>
Aug 17 09:08:53 user nova-compute[72998]:       <entry name="uuid">b0b337a9-f43b-4f0d-b8b7-93da0496e4a5</entry>
Aug 17 09:08:53 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 09:08:53 user nova-compute[72998]:     </system>
Aug 17 09:08:53 user nova-compute[72998]:   </sysinfo>
Aug 17 09:08:53 user nova-compute[72998]:   <os>
Aug 17 09:08:53 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 09:08:53 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 09:08:53 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 09:08:53 user nova-compute[72998]:   </os>
Aug 17 09:08:53 user nova-compute[72998]:   <features>
Aug 17 09:08:53 user nova-compute[72998]:     <acpi/>
Aug 17 09:08:53 user nova-compute[72998]:     <apic/>
Aug 17 09:08:53 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 09:08:53 user nova-compute[72998]:   </features>
Aug 17 09:08:53 user nova-compute[72998]:   <clock offset="utc">
Aug 17 09:08:53 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 09:08:53 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 09:08:53 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 09:08:53 user nova-compute[72998]:   </clock>
Aug 17 09:08:53 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 09:08:53 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 09:08:53 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 09:08:53 user nova-compute[72998]:   </cpu>
Aug 17 09:08:53 user nova-compute[72998]:   <devices>
Aug 17 09:08:53 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 09:08:53 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:08:53 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 09:08:53 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 09:08:53 user nova-compute[72998]:       <serial>a7d15e89-923e-4cb1-a9dd-9bbe3057d21a</serial>
Aug 17 09:08:53 user nova-compute[72998]:     </disk>
Aug 17 09:08:53 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 09:08:53 user nova-compute[72998]:       <mac address="fa:16:3e:60:c8:31"/>
Aug 17 09:08:53 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:08:53 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 09:08:53 user nova-compute[72998]:       <target dev="tap2ddf97a7-86"/>
Aug 17 09:08:53 user nova-compute[72998]:     </interface>
Aug 17 09:08:53 user nova-compute[72998]:     <serial type="pty">
Aug 17 09:08:53 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/b0b337a9-f43b-4f0d-b8b7-93da0496e4a5/console.log" append="off"/>
Aug 17 09:08:53 user nova-compute[72998]:     </serial>
Aug 17 09:08:53 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 09:08:53 user nova-compute[72998]:     <video>
Aug 17 09:08:53 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:08:53 user nova-compute[72998]:     </video>
Aug 17 09:08:53 user nova-compute[72998]:     <rng model="virtio">
Aug 17 09:08:53 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 09:08:53 user nova-compute[72998]:     </rng>
Aug 17 09:08:53 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 09:08:53 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 09:08:53 user nova-compute[72998]:       <stats period="10"/>
Aug 17 09:08:53 user nova-compute[72998]:     </memballoon>
Aug 17 09:08:53 user nova-compute[72998]:   </devices>
Aug 17 09:08:53 user nova-compute[72998]: </domain>
Aug 17 09:08:53 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:08:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1014438104',display_name='tempest-TestVolumeBootPattern-server-1014438104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1014438104',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjTvZgPHFA5zBVDLHwQ6Ik5MpYZKcO/hQ32p5utozUsMbB3Fzp27hH7yFw7YeaiL3gq/7ZnzFRee+WqPWYMFQz72qtVyqekinvIoyNOitgO17CuXEPrxfvfZhU1aFHv1A==',key_name='tempest-TestVolumeBootPattern-347598242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-p5dqx4uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:08:41Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=b0b337a9-f43b-4f0d-b8b7-93da0496e4a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:c8:31,bridge_name='br-int',has_traffic_filtering=True,id=2ddf97a7-8674-4360-9cbc-32da6a8e7dba,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddf97a7-86') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG os_vif [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:c8:31,bridge_name='br-int',has_traffic_filtering=True,id=2ddf97a7-8674-4360-9cbc-32da6a8e7dba,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddf97a7-86') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ddf97a7-86, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ddf97a7-86, col_values=(('external_ids', {'iface-id': '2ddf97a7-8674-4360-9cbc-32da6a8e7dba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:c8:31', 'vm-uuid': 'b0b337a9-f43b-4f0d-b8b7-93da0496e4a5'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:53 user nova-compute[72998]: INFO os_vif [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:c8:31,bridge_name='br-int',has_traffic_filtering=True,id=2ddf97a7-8674-4360-9cbc-32da6a8e7dba,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddf97a7-86')
Aug 17 09:08:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:08:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No VIF found with MAC fa:16:3e:60:c8:31, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-d58f5fbf-cd35-4bf2-893b-7fce662ff227 req-4fa198e2-906f-4792-93ec-978675972505 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received event network-vif-plugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d58f5fbf-cd35-4bf2-893b-7fce662ff227 req-4fa198e2-906f-4792-93ec-978675972505 service nova] Acquiring lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d58f5fbf-cd35-4bf2-893b-7fce662ff227 req-4fa198e2-906f-4792-93ec-978675972505 service nova] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d58f5fbf-cd35-4bf2-893b-7fce662ff227 req-4fa198e2-906f-4792-93ec-978675972505 service nova] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG nova.compute.manager [req-d58f5fbf-cd35-4bf2-893b-7fce662ff227 req-4fa198e2-906f-4792-93ec-978675972505 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] No waiting events found dispatching network-vif-plugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:08:54 user nova-compute[72998]: WARNING nova.compute.manager [req-d58f5fbf-cd35-4bf2-893b-7fce662ff227 req-4fa198e2-906f-4792-93ec-978675972505 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received unexpected event network-vif-plugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba for instance with vm_state building and task_state spawning.
Aug 17 09:08:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263336.361732, b0b337a9-f43b-4f0d-b8b7-93da0496e4a5 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:08:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] VM Resumed (Lifecycle Event)
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 09:08:56 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Instance spawned successfully.
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:08:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263336.3647523, b0b337a9-f43b-4f0d-b8b7-93da0496e4a5 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:08:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] VM Started (Lifecycle Event)
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:08:56 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:08:56 user nova-compute[72998]: INFO nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-8e08ac25-008e-4950-95ff-818d8a21229f req-57cc4d04-e8db-4bb3-a035-39002739fc24 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received event network-vif-plugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8e08ac25-008e-4950-95ff-818d8a21229f req-57cc4d04-e8db-4bb3-a035-39002739fc24 service nova] Acquiring lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8e08ac25-008e-4950-95ff-818d8a21229f req-57cc4d04-e8db-4bb3-a035-39002739fc24 service nova] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8e08ac25-008e-4950-95ff-818d8a21229f req-57cc4d04-e8db-4bb3-a035-39002739fc24 service nova] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG nova.compute.manager [req-8e08ac25-008e-4950-95ff-818d8a21229f req-57cc4d04-e8db-4bb3-a035-39002739fc24 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] No waiting events found dispatching network-vif-plugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:08:56 user nova-compute[72998]: WARNING nova.compute.manager [req-8e08ac25-008e-4950-95ff-818d8a21229f req-57cc4d04-e8db-4bb3-a035-39002739fc24 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received unexpected event network-vif-plugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba for instance with vm_state building and task_state spawning.
Aug 17 09:08:56 user nova-compute[72998]: INFO nova.compute.manager [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Took 15.64 seconds to build instance.
Aug 17 09:08:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7f37ad27-0396-4d52-9bd6-7ce2bcc53e15 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.749s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:08:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:08:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:14 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:09:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:09:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:09:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:09:35 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:09:35 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid b0b337a9-f43b-4f0d-b8b7-93da0496e4a5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:09:36 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Updating instance_info_cache with network_info: [{"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:09:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:09:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:09:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:43 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:09:45 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:50 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:09:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:09:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:09:50 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:09:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:09:51 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:09:51 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:09:51 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=24.060386657714844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:09:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:09:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:09:51 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance b0b337a9-f43b-4f0d-b8b7-93da0496e4a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:09:51 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:09:51 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:09:51 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:09:51 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:09:51 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:09:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:09:53 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:09:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:09:58 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:09:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:10:13 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:10:18 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:10:28 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-578a9c32-8348-4c2c-9719-691a5fc1f98e req-b096b6ea-de37-40d2-9a8e-dd8dadc17a8b service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received event network-changed-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:10:32 user nova-compute[72998]: DEBUG nova.compute.manager [req-578a9c32-8348-4c2c-9719-691a5fc1f98e req-b096b6ea-de37-40d2-9a8e-dd8dadc17a8b service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Refreshing instance network info cache due to event network-changed-2ddf97a7-8674-4360-9cbc-32da6a8e7dba. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:10:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-578a9c32-8348-4c2c-9719-691a5fc1f98e req-b096b6ea-de37-40d2-9a8e-dd8dadc17a8b service nova] Acquiring lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:10:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-578a9c32-8348-4c2c-9719-691a5fc1f98e req-b096b6ea-de37-40d2-9a8e-dd8dadc17a8b service nova] Acquired lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:10:32 user nova-compute[72998]: DEBUG nova.network.neutron [req-578a9c32-8348-4c2c-9719-691a5fc1f98e req-b096b6ea-de37-40d2-9a8e-dd8dadc17a8b service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Refreshing network info cache for port 2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG nova.network.neutron [req-578a9c32-8348-4c2c-9719-691a5fc1f98e req-b096b6ea-de37-40d2-9a8e-dd8dadc17a8b service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Updated VIF entry in instance network info cache for port 2ddf97a7-8674-4360-9cbc-32da6a8e7dba. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG nova.network.neutron [req-578a9c32-8348-4c2c-9719-691a5fc1f98e req-b096b6ea-de37-40d2-9a8e-dd8dadc17a8b service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Updating instance_info_cache with network_info: [{"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-578a9c32-8348-4c2c-9719-691a5fc1f98e req-b096b6ea-de37-40d2-9a8e-dd8dadc17a8b service nova] Releasing lock "refresh_cache-b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:10:33 user nova-compute[72998]: INFO nova.compute.manager [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Terminating instance
Aug 17 09:10:33 user nova-compute[72998]: DEBUG nova.compute.manager [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-b4677aa5-5d42-46c5-84d9-36c6905666bb req-bf9ce456-4c89-4f44-ab1a-350590ef201f service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received event network-vif-unplugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b4677aa5-5d42-46c5-84d9-36c6905666bb req-bf9ce456-4c89-4f44-ab1a-350590ef201f service nova] Acquiring lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b4677aa5-5d42-46c5-84d9-36c6905666bb req-bf9ce456-4c89-4f44-ab1a-350590ef201f service nova] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b4677aa5-5d42-46c5-84d9-36c6905666bb req-bf9ce456-4c89-4f44-ab1a-350590ef201f service nova] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-b4677aa5-5d42-46c5-84d9-36c6905666bb req-bf9ce456-4c89-4f44-ab1a-350590ef201f service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] No waiting events found dispatching network-vif-unplugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:10:33 user nova-compute[72998]: DEBUG nova.compute.manager [req-b4677aa5-5d42-46c5-84d9-36c6905666bb req-bf9ce456-4c89-4f44-ab1a-350590ef201f service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received event network-vif-unplugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 09:10:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Instance destroyed successfully.
Aug 17 09:10:34 user nova-compute[72998]: DEBUG nova.objects.instance [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'resources' on Instance uuid b0b337a9-f43b-4f0d-b8b7-93da0496e4a5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:08:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1014438104',display_name='tempest-TestVolumeBootPattern-server-1014438104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1014438104',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjTvZgPHFA5zBVDLHwQ6Ik5MpYZKcO/hQ32p5utozUsMbB3Fzp27hH7yFw7YeaiL3gq/7ZnzFRee+WqPWYMFQz72qtVyqekinvIoyNOitgO17CuXEPrxfvfZhU1aFHv1A==',key_name='tempest-TestVolumeBootPattern-347598242',keypairs=<?>,launch_index=0,launched_at=2023-08-17T09:08:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-p5dqx4uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T09:08:57Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=b0b337a9-f43b-4f0d-b8b7-93da0496e4a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "address": "fa:16:3e:60:c8:31", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddf97a7-86", "ovs_interfaceid": "2ddf97a7-8674-4360-9cbc-32da6a8e7dba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:c8:31,bridge_name='br-int',has_traffic_filtering=True,id=2ddf97a7-8674-4360-9cbc-32da6a8e7dba,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddf97a7-86') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_vif [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:c8:31,bridge_name='br-int',has_traffic_filtering=True,id=2ddf97a7-8674-4360-9cbc-32da6a8e7dba,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddf97a7-86') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ddf97a7-86, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:10:34 user nova-compute[72998]: INFO os_vif [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:c8:31,bridge_name='br-int',has_traffic_filtering=True,id=2ddf97a7-8674-4360-9cbc-32da6a8e7dba,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ddf97a7-86')
Aug 17 09:10:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGKychbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:10:34 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aac341-b6f6-4f1b-9e31-410e87c46fd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d72322-da12-4128-a19a-b8af1fd9a501]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:10:34 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:10:34 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464a184c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a67fca-c183-41e0-89ed-51e69ac46529]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d4daa2-7509-471d-8c4e-969bf3d8791a]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e477883-155d-47d1-ab7b-b4498c7880c4]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2392f53c-fc62-41db-b03e-38c5bd6d5e1b]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23665303162336239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_edc2597a', '/dev/disk/by-id/scsi-1SCST_BIOedc2597a-6e01b3b9c6a22b0b') {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd3c2b7-c35e-47b2-a1de-25fab73f46d1]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f0474b-8c2c-4a2d-9558-4b9f7477c335]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[065cbd82-3631-435d-9913-484e6c966659]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260]
Aug 17 09:10:34 user nova-compute[72998]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260] successful.
Aug 17 09:10:34 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c3e6a5-23aa-4a69-a8b8-35315d82276f]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== disconnect_volume: return (285ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:10:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Deleting instance files /opt/stack/data/nova/instances/b0b337a9-f43b-4f0d-b8b7-93da0496e4a5_del
Aug 17 09:10:34 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Deletion of /opt/stack/data/nova/instances/b0b337a9-f43b-4f0d-b8b7-93da0496e4a5_del complete
Aug 17 09:10:34 user nova-compute[72998]: INFO nova.compute.manager [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 17 09:10:34 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 09:10:34 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 09:10:35 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:10:35 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Took 0.76 seconds to deallocate network for instance.
Aug 17 09:10:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-91b23008-8f14-49d5-bca6-d93c84a2c697 req-e4d8f760-7f4d-405b-be85-281e95b15881 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received event network-vif-plugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:10:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-91b23008-8f14-49d5-bca6-d93c84a2c697 req-e4d8f760-7f4d-405b-be85-281e95b15881 service nova] Acquiring lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:10:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-91b23008-8f14-49d5-bca6-d93c84a2c697 req-e4d8f760-7f4d-405b-be85-281e95b15881 service nova] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:10:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-91b23008-8f14-49d5-bca6-d93c84a2c697 req-e4d8f760-7f4d-405b-be85-281e95b15881 service nova] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:10:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-91b23008-8f14-49d5-bca6-d93c84a2c697 req-e4d8f760-7f4d-405b-be85-281e95b15881 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] No waiting events found dispatching network-vif-plugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:10:35 user nova-compute[72998]: WARNING nova.compute.manager [req-91b23008-8f14-49d5-bca6-d93c84a2c697 req-e4d8f760-7f4d-405b-be85-281e95b15881 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received unexpected event network-vif-plugged-2ddf97a7-8674-4360-9cbc-32da6a8e7dba for instance with vm_state active and task_state deleting.
Aug 17 09:10:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-91b23008-8f14-49d5-bca6-d93c84a2c697 req-e4d8f760-7f4d-405b-be85-281e95b15881 service nova] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Received event network-vif-deleted-2ddf97a7-8674-4360-9cbc-32da6a8e7dba {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:10:36 user nova-compute[72998]: INFO nova.compute.manager [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 09:10:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:10:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:10:36 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:10:36 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:10:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:10:36 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Deleted allocations for instance b0b337a9-f43b-4f0d-b8b7-93da0496e4a5
Aug 17 09:10:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-980da262-1dcf-4d2f-96ac-0356f9ca7bef tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "b0b337a9-f43b-4f0d-b8b7-93da0496e4a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:10:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:10:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:10:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:10:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:10:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:10:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:10:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:10:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:10:47 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:47 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:49 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692263434.1495626, b0b337a9-f43b-4f0d-b8b7-93da0496e4a5 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:10:49 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] VM Stopped (Lifecycle Event)
Aug 17 09:10:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-c8c1eaa4-4223-432e-ba44-983a3106ef26 None None] [instance: b0b337a9-f43b-4f0d-b8b7-93da0496e4a5] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:10:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:10:49 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:51 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:10:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:10:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:10:51 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:10:52 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:10:52 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=24.05956268310547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:10:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:10:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:10:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:10:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:10:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 09:10:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:11:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 09:11:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 09:11:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:11:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:11:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 09:11:25 user nova-compute[72998]: INFO nova.compute.claims [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Claim successful on node user
Aug 17 09:11:25 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 09:11:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 09:11:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 09:11:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 09:11:25 user nova-compute[72998]: INFO nova.virt.block_device [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Booting with volume a7d15e89-923e-4cb1-a9dd-9bbe3057d21a at /dev/vda
Aug 17 09:11:25 user nova-compute[72998]: DEBUG nova.policy [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeab5ccaa12540cf950a9461460cb6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e261c30b0a34357895224cf4772b371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG os_brick.utils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f27536-35a7-4dac-ab18-ffa94c9e6338]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3218452b-5a35-4293-a1b1-2bce3acbf37e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d3c8b9-bc6a-4a96-a418-b5b9a308df04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[833e1485-4c44-4650-bce0-055784b84b5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:11:26 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:11:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d445bcab-ae53-435f-9bde-08d44f121370]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG os_brick.utils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updating existing volume attachment record: 3cffd62e-c923-4590-b07d-5a4057f2e9b7 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:11:26 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Successfully created port: 0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Successfully updated port: 0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquired lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-71522c03-3b73-4bc8-aba6-f80c19c604af req-907ba9c9-9ecf-4f83-8974-0f93568b689a service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received event network-changed-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-71522c03-3b73-4bc8-aba6-f80c19c604af req-907ba9c9-9ecf-4f83-8974-0f93568b689a service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Refreshing instance network info cache due to event network-changed-0425f39c-8a67-4ca6-b524-6e6b1c162c99. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71522c03-3b73-4bc8-aba6-f80c19c604af req-907ba9c9-9ecf-4f83-8974-0f93568b689a service nova] Acquiring lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG nova.network.neutron [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updating instance_info_cache with network_info: [{"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Releasing lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Instance network_info: |[{"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71522c03-3b73-4bc8-aba6-f80c19c604af req-907ba9c9-9ecf-4f83-8974-0f93568b689a service nova] Acquired lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:11:27 user nova-compute[72998]: DEBUG nova.network.neutron [req-71522c03-3b73-4bc8-aba6-f80c19c604af req-907ba9c9-9ecf-4f83-8974-0f93568b689a service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Refreshing network info cache for port 0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:11:28 user nova-compute[72998]: DEBUG nova.network.neutron [req-71522c03-3b73-4bc8-aba6-f80c19c604af req-907ba9c9-9ecf-4f83-8974-0f93568b689a service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updated VIF entry in instance network info cache for port 0425f39c-8a67-4ca6-b524-6e6b1c162c99. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:11:28 user nova-compute[72998]: DEBUG nova.network.neutron [req-71522c03-3b73-4bc8-aba6-f80c19c604af req-907ba9c9-9ecf-4f83-8974-0f93568b689a service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updating instance_info_cache with network_info: [{"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:11:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-71522c03-3b73-4bc8-aba6-f80c19c604af req-907ba9c9-9ecf-4f83-8974-0f93568b689a service nova] Releasing lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:11:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 09:11:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Creating image(s)
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Ensure instance console log exists: /opt/stack/data/nova/instances/c0aa43fe-1379-4f4e-b08e-08c3e671f3f2/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Start _get_guest_xml network_info=[{"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3cffd62e-c923-4590-b07d-5a4057f2e9b7', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGKychbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0aa43fe-1379-4f4e-b08e-08c3e671f3f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7d15e89-923e-4cb1-a9dd-9bbe3057d21a', 'serial': 'a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 09:11:36 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:11:36 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGKychbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:11:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:11:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:11:36 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db520fb-8aac-4c81-95fb-970968af2526]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:11:36 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eea89f-38d5-4ebc-93f9-41bb7bfc2fec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a] added
Aug 17 09:11:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c502f746-aed3-4846-8181-99789bd60800]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd3754-0137-41c0-aefa-23e2c78eb28e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGKychbn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGKychbn" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffad2e74-0954-4229-8598-617c9279963b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HGKychbn'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db427e-6607-47b0-90f9-4638febd3a8a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a053a088-eee9-46c1-aad8-d2d5284a7369]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:11:36 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:11:36 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:11:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:11:36 user nova-compute[72998]: 
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f8d9f-c540-4248-9359-3803e8504eee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260]
Aug 17 09:11:36 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260] successful.
Aug 17 09:11:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[26abf555-5442-4f58-8059-31f092fa73b7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fcfa04-bd72-4070-958a-a19f019b94ac]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:11:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:11:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fa0423-0a88-4d1d-9b70-cf94aa216397]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:11:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGKychbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23665303162336239', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665303162336239', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1941328574',display_name='tempest-TestVolumeBootPattern-server-1941328574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1941328574',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjTvZgPHFA5zBVDLHwQ6Ik5MpYZKcO/hQ32p5utozUsMbB3Fzp27hH7yFw7YeaiL3gq/7ZnzFRee+WqPWYMFQz72qtVyqekinvIoyNOitgO17CuXEPrxfvfZhU1aFHv1A==',key_name='tempest-TestVolumeBootPattern-347598242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-4bl76z2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:11:26Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=c0aa43fe-1379-4f4e-b08e-08c3e671f3f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=0425f39c-8a67-4ca6-b524-6e6b1c162c99,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0425f39c-8a') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'pci_devices' on Instance uuid c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 09:11:37 user nova-compute[72998]:   <uuid>c0aa43fe-1379-4f4e-b08e-08c3e671f3f2</uuid>
Aug 17 09:11:37 user nova-compute[72998]:   <name>instance-00000032</name>
Aug 17 09:11:37 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 09:11:37 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 09:11:37 user nova-compute[72998]:   <metadata>
Aug 17 09:11:37 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 09:11:37 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 09:11:37 user nova-compute[72998]:       <nova:name>tempest-TestVolumeBootPattern-server-1941328574</nova:name>
Aug 17 09:11:37 user nova-compute[72998]:       <nova:creationTime>2023-08-17 09:11:36</nova:creationTime>
Aug 17 09:11:37 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 09:11:37 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 09:11:37 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 09:11:37 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 09:11:37 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 09:11:37 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 09:11:37 user nova-compute[72998]:       </nova:flavor>
Aug 17 09:11:37 user nova-compute[72998]:       <nova:owner>
Aug 17 09:11:37 user nova-compute[72998]:         <nova:user uuid="eeab5ccaa12540cf950a9461460cb6ae">tempest-TestVolumeBootPattern-496980120-project-member</nova:user>
Aug 17 09:11:37 user nova-compute[72998]:         <nova:project uuid="3e261c30b0a34357895224cf4772b371">tempest-TestVolumeBootPattern-496980120</nova:project>
Aug 17 09:11:37 user nova-compute[72998]:       </nova:owner>
Aug 17 09:11:37 user nova-compute[72998]:       <nova:ports>
Aug 17 09:11:37 user nova-compute[72998]:         <nova:port uuid="0425f39c-8a67-4ca6-b524-6e6b1c162c99">
Aug 17 09:11:37 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 09:11:37 user nova-compute[72998]:         </nova:port>
Aug 17 09:11:37 user nova-compute[72998]:       </nova:ports>
Aug 17 09:11:37 user nova-compute[72998]:     </nova:instance>
Aug 17 09:11:37 user nova-compute[72998]:   </metadata>
Aug 17 09:11:37 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 09:11:37 user nova-compute[72998]:     <system>
Aug 17 09:11:37 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 09:11:37 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 09:11:37 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 09:11:37 user nova-compute[72998]:       <entry name="serial">c0aa43fe-1379-4f4e-b08e-08c3e671f3f2</entry>
Aug 17 09:11:37 user nova-compute[72998]:       <entry name="uuid">c0aa43fe-1379-4f4e-b08e-08c3e671f3f2</entry>
Aug 17 09:11:37 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 09:11:37 user nova-compute[72998]:     </system>
Aug 17 09:11:37 user nova-compute[72998]:   </sysinfo>
Aug 17 09:11:37 user nova-compute[72998]:   <os>
Aug 17 09:11:37 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 09:11:37 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 09:11:37 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 09:11:37 user nova-compute[72998]:   </os>
Aug 17 09:11:37 user nova-compute[72998]:   <features>
Aug 17 09:11:37 user nova-compute[72998]:     <acpi/>
Aug 17 09:11:37 user nova-compute[72998]:     <apic/>
Aug 17 09:11:37 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 09:11:37 user nova-compute[72998]:   </features>
Aug 17 09:11:37 user nova-compute[72998]:   <clock offset="utc">
Aug 17 09:11:37 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 09:11:37 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 09:11:37 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 09:11:37 user nova-compute[72998]:   </clock>
Aug 17 09:11:37 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 09:11:37 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 09:11:37 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 09:11:37 user nova-compute[72998]:   </cpu>
Aug 17 09:11:37 user nova-compute[72998]:   <devices>
Aug 17 09:11:37 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 09:11:37 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:11:37 user nova-compute[72998]:       <source dev="/dev/sdb"/>
Aug 17 09:11:37 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 09:11:37 user nova-compute[72998]:       <serial>a7d15e89-923e-4cb1-a9dd-9bbe3057d21a</serial>
Aug 17 09:11:37 user nova-compute[72998]:     </disk>
Aug 17 09:11:37 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 09:11:37 user nova-compute[72998]:       <mac address="fa:16:3e:e2:40:1e"/>
Aug 17 09:11:37 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:11:37 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 09:11:37 user nova-compute[72998]:       <target dev="tap0425f39c-8a"/>
Aug 17 09:11:37 user nova-compute[72998]:     </interface>
Aug 17 09:11:37 user nova-compute[72998]:     <serial type="pty">
Aug 17 09:11:37 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/c0aa43fe-1379-4f4e-b08e-08c3e671f3f2/console.log" append="off"/>
Aug 17 09:11:37 user nova-compute[72998]:     </serial>
Aug 17 09:11:37 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 09:11:37 user nova-compute[72998]:     <video>
Aug 17 09:11:37 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:11:37 user nova-compute[72998]:     </video>
Aug 17 09:11:37 user nova-compute[72998]:     <rng model="virtio">
Aug 17 09:11:37 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 09:11:37 user nova-compute[72998]:     </rng>
Aug 17 09:11:37 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 09:11:37 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 09:11:37 user nova-compute[72998]:       <stats period="10"/>
Aug 17 09:11:37 user nova-compute[72998]:     </memballoon>
Aug 17 09:11:37 user nova-compute[72998]:   </devices>
Aug 17 09:11:37 user nova-compute[72998]: </domain>
Aug 17 09:11:37 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1941328574',display_name='tempest-TestVolumeBootPattern-server-1941328574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1941328574',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjTvZgPHFA5zBVDLHwQ6Ik5MpYZKcO/hQ32p5utozUsMbB3Fzp27hH7yFw7YeaiL3gq/7ZnzFRee+WqPWYMFQz72qtVyqekinvIoyNOitgO17CuXEPrxfvfZhU1aFHv1A==',key_name='tempest-TestVolumeBootPattern-347598242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-4bl76z2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:11:26Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=c0aa43fe-1379-4f4e-b08e-08c3e671f3f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=0425f39c-8a67-4ca6-b524-6e6b1c162c99,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0425f39c-8a') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG os_vif [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=0425f39c-8a67-4ca6-b524-6e6b1c162c99,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0425f39c-8a') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0425f39c-8a, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0425f39c-8a, col_values=(('external_ids', {'iface-id': '0425f39c-8a67-4ca6-b524-6e6b1c162c99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:40:1e', 'vm-uuid': 'c0aa43fe-1379-4f4e-b08e-08c3e671f3f2'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:37 user nova-compute[72998]: INFO os_vif [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=0425f39c-8a67-4ca6-b524-6e6b1c162c99,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0425f39c-8a')
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:11:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No VIF found with MAC fa:16:3e:e2:40:1e, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Skipping network cache update for instance because it is Building. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-7fbadd7c-6da6-4bfc-b688-efde05d05d1a req-980757de-3e1b-4a61-80db-69dfe69a0db6 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received event network-vif-plugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7fbadd7c-6da6-4bfc-b688-efde05d05d1a req-980757de-3e1b-4a61-80db-69dfe69a0db6 service nova] Acquiring lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7fbadd7c-6da6-4bfc-b688-efde05d05d1a req-980757de-3e1b-4a61-80db-69dfe69a0db6 service nova] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-7fbadd7c-6da6-4bfc-b688-efde05d05d1a req-980757de-3e1b-4a61-80db-69dfe69a0db6 service nova] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:11:38 user nova-compute[72998]: DEBUG nova.compute.manager [req-7fbadd7c-6da6-4bfc-b688-efde05d05d1a req-980757de-3e1b-4a61-80db-69dfe69a0db6 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] No waiting events found dispatching network-vif-plugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:11:38 user nova-compute[72998]: WARNING nova.compute.manager [req-7fbadd7c-6da6-4bfc-b688-efde05d05d1a req-980757de-3e1b-4a61-80db-69dfe69a0db6 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received unexpected event network-vif-plugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 for instance with vm_state building and task_state spawning.
Aug 17 09:11:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263500.861538, c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:11:40 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] VM Resumed (Lifecycle Event)
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 09:11:40 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Instance spawned successfully.
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:11:40 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263500.8657231, c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:11:40 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] VM Started (Lifecycle Event)
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:11:40 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:11:40 user nova-compute[72998]: INFO nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Took 4.85 seconds to spawn the instance on the hypervisor.
Aug 17 09:11:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:11:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-450197fc-7258-4e03-bb72-061b4427a93d req-be0975f8-c85b-423e-9c11-34158851404b service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received event network-vif-plugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:11:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-450197fc-7258-4e03-bb72-061b4427a93d req-be0975f8-c85b-423e-9c11-34158851404b service nova] Acquiring lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:11:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-450197fc-7258-4e03-bb72-061b4427a93d req-be0975f8-c85b-423e-9c11-34158851404b service nova] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:11:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-450197fc-7258-4e03-bb72-061b4427a93d req-be0975f8-c85b-423e-9c11-34158851404b service nova] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:11:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-450197fc-7258-4e03-bb72-061b4427a93d req-be0975f8-c85b-423e-9c11-34158851404b service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] No waiting events found dispatching network-vif-plugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:11:41 user nova-compute[72998]: WARNING nova.compute.manager [req-450197fc-7258-4e03-bb72-061b4427a93d req-be0975f8-c85b-423e-9c11-34158851404b service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received unexpected event network-vif-plugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 for instance with vm_state building and task_state spawning.
Aug 17 09:11:41 user nova-compute[72998]: INFO nova.compute.manager [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Took 15.69 seconds to build instance.
Aug 17 09:11:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e5dd84d2-3e12-4709-9a16-85500cdeff8e tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.783s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:11:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:11:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:49 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:50 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:51 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:11:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:11:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:11:51 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:11:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:11:52 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:11:52 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:11:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=24.057952880859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:11:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 09:11:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:11:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:11:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:11:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:11:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:11:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:11:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:12:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:12:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:12:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:12:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:12:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:12:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:12:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:12:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:12:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:12:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:12:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:12:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:12:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:12:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:12:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:12:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:12:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:12:40 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:12:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updating instance_info_cache with network_info: [{"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:12:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:12:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:12:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:12:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:12:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:50 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:12:50 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:12:51 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:12:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:12:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:12:51 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:12:51 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:12:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:12:52 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:12:52 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:12:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=24.05728530883789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:12:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:12:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:12:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:12:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:12:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:12:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:12:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:12:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:12:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:12:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:13:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:13:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:13:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:13:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:13:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:13:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:13:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:13:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:13:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:13:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:18 user nova-compute[72998]: DEBUG nova.compute.manager [req-d3621028-8ef5-4b6b-88fd-c801ef6e0f55 req-0e340abb-45f1-44d7-9cdb-c07273a321b2 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received event network-changed-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:13:18 user nova-compute[72998]: DEBUG nova.compute.manager [req-d3621028-8ef5-4b6b-88fd-c801ef6e0f55 req-0e340abb-45f1-44d7-9cdb-c07273a321b2 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Refreshing instance network info cache due to event network-changed-0425f39c-8a67-4ca6-b524-6e6b1c162c99. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:13:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d3621028-8ef5-4b6b-88fd-c801ef6e0f55 req-0e340abb-45f1-44d7-9cdb-c07273a321b2 service nova] Acquiring lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:13:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d3621028-8ef5-4b6b-88fd-c801ef6e0f55 req-0e340abb-45f1-44d7-9cdb-c07273a321b2 service nova] Acquired lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:13:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-d3621028-8ef5-4b6b-88fd-c801ef6e0f55 req-0e340abb-45f1-44d7-9cdb-c07273a321b2 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Refreshing network info cache for port 0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:13:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-d3621028-8ef5-4b6b-88fd-c801ef6e0f55 req-0e340abb-45f1-44d7-9cdb-c07273a321b2 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updated VIF entry in instance network info cache for port 0425f39c-8a67-4ca6-b524-6e6b1c162c99. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:13:18 user nova-compute[72998]: DEBUG nova.network.neutron [req-d3621028-8ef5-4b6b-88fd-c801ef6e0f55 req-0e340abb-45f1-44d7-9cdb-c07273a321b2 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updating instance_info_cache with network_info: [{"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:13:18 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-d3621028-8ef5-4b6b-88fd-c801ef6e0f55 req-0e340abb-45f1-44d7-9cdb-c07273a321b2 service nova] Releasing lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:13:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 09:13:32 user nova-compute[72998]: INFO nova.compute.claims [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Claim successful on node user
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.network.neutron [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 09:13:32 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 09:13:32 user nova-compute[72998]: INFO nova.virt.block_device [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Booting with volume 565ed49e-03b6-4650-8ae4-34e21c1ca611 at /dev/vda
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.policy [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeab5ccaa12540cf950a9461460cb6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e261c30b0a34357895224cf4772b371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG os_brick.utils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb65e06-7db0-4de0-86f6-0ee6e1128519]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f719b-5aeb-4834-8406-fe2e9255d826]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03c17b-1898-44bf-bb06-30edf589fb12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd153233-6e6f-46a7-8cf1-a53126c6f394]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:13:32 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:13:32 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5f0c7c-5253-46c2-98c9-172ee56ed298]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG os_brick.utils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:13:32 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Updating existing volume attachment record: 02af2390-439b-452a-96e6-36f10ff47263 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:13:33 user nova-compute[72998]: DEBUG nova.network.neutron [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Successfully created port: 63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Successfully updated port: 63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquired lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.compute.manager [req-c51eb1b1-af84-4a8c-b2ba-d2aa443902a6 req-49f22e20-5026-4370-8176-dae8337b1c38 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-changed-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.compute.manager [req-c51eb1b1-af84-4a8c-b2ba-d2aa443902a6 req-49f22e20-5026-4370-8176-dae8337b1c38 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Refreshing instance network info cache due to event network-changed-63b50546-146b-45b5-941a-0da4f9cc58e7. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c51eb1b1-af84-4a8c-b2ba-d2aa443902a6 req-49f22e20-5026-4370-8176-dae8337b1c38 service nova] Acquiring lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.network.neutron [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Updating instance_info_cache with network_info: [{"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Releasing lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Instance network_info: |[{"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c51eb1b1-af84-4a8c-b2ba-d2aa443902a6 req-49f22e20-5026-4370-8176-dae8337b1c38 service nova] Acquired lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.network.neutron [req-c51eb1b1-af84-4a8c-b2ba-d2aa443902a6 req-49f22e20-5026-4370-8176-dae8337b1c38 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Refreshing network info cache for port 63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.network.neutron [req-c51eb1b1-af84-4a8c-b2ba-d2aa443902a6 req-49f22e20-5026-4370-8176-dae8337b1c38 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Updated VIF entry in instance network info cache for port 63b50546-146b-45b5-941a-0da4f9cc58e7. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG nova.network.neutron [req-c51eb1b1-af84-4a8c-b2ba-d2aa443902a6 req-49f22e20-5026-4370-8176-dae8337b1c38 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Updating instance_info_cache with network_info: [{"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:13:34 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-c51eb1b1-af84-4a8c-b2ba-d2aa443902a6 req-49f22e20-5026-4370-8176-dae8337b1c38 service nova] Releasing lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:13:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:13:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:13:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:13:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:13:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:13:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:13:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Skipping network cache update for instance because it is Building. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 09:13:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:13:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:13:39 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:13:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:13:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updating instance_info_cache with network_info: [{"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:13:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:13:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:13:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:13:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:13:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:13:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:13:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 09:13:43 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Creating image(s)
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Did not create local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Ensure instance console log exists: /opt/stack/data/nova/instances/a7adc4b1-ecc8-431c-906d-5d197dd6289c/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Start _get_guest_xml network_info=[{"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '02af2390-439b-452a-96e6-36f10ff47263', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxZJwIMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7adc4b1-ecc8-431c-906d-5d197dd6289c', 'attached_at': '', 'detached_at': '', 'volume_id': '565ed49e-03b6-4650-8ae4-34e21c1ca611', 'serial': '565ed49e-03b6-4650-8ae4-34e21c1ca611'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 09:13:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:13:43 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxZJwIMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:13:43 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:13:43 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:13:43 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac352312-d907-446c-87d4-750057a20b99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:13:43 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[57becd0b-1587-4eed-bbde-bdc8ce660450]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611] added
Aug 17 09:13:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d46a8b-1326-492a-a30f-27026ad8b758]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2a9e76-9645-46e5-800c-9b1c68e91d93]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxZJwIMm {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxZJwIMm" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[590ee9e5-4f6e-452d-8504-f4eba571aeb1]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fxZJwIMm'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2c4efd-2acb-412d-b7d1-f69637d96405]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f2bd8-8113-426a-9570-2c1d4dec0218]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:13:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:13:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b1330b-c7e0-4d8f-a00e-f003565722fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611, portal: 172.16.0.220,3260]
Aug 17 09:13:43 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611, portal: 172.16.0.220,3260] successful.
Aug 17 09:13:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9113a62f-745d-4107-b6ca-ddfb7735da53]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94cbaea-97f4-4083-a93b-23b591d4b4de]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:13:43 user nova-compute[72998]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 (non-flash)
Aug 17 09:13:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:13:43 user nova-compute[72998]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 (non-flash)
Aug 17 09:13:43 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db4f79d-69f0-4c96-bb0d-e49d302117ca]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:13:43 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxZJwIMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23234303831373433', 'path': '/dev/sdc'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234303831373433', 'path': '/dev/sdc'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2064468254',display_name='tempest-TestVolumeBootPattern-server-2064468254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2064468254',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjTvZgPHFA5zBVDLHwQ6Ik5MpYZKcO/hQ32p5utozUsMbB3Fzp27hH7yFw7YeaiL3gq/7ZnzFRee+WqPWYMFQz72qtVyqekinvIoyNOitgO17CuXEPrxfvfZhU1aFHv1A==',key_name='tempest-TestVolumeBootPattern-347598242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-82l01jsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:13:32Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=a7adc4b1-ecc8-431c-906d-5d197dd6289c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7e:e0,bridge_name='br-int',has_traffic_filtering=True,id=63b50546-146b-45b5-941a-0da4f9cc58e7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b50546-14') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.objects.instance [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'pci_devices' on Instance uuid a7adc4b1-ecc8-431c-906d-5d197dd6289c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 09:13:44 user nova-compute[72998]:   <uuid>a7adc4b1-ecc8-431c-906d-5d197dd6289c</uuid>
Aug 17 09:13:44 user nova-compute[72998]:   <name>instance-00000033</name>
Aug 17 09:13:44 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 09:13:44 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 09:13:44 user nova-compute[72998]:   <metadata>
Aug 17 09:13:44 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 09:13:44 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 09:13:44 user nova-compute[72998]:       <nova:name>tempest-TestVolumeBootPattern-server-2064468254</nova:name>
Aug 17 09:13:44 user nova-compute[72998]:       <nova:creationTime>2023-08-17 09:13:43</nova:creationTime>
Aug 17 09:13:44 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 09:13:44 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 09:13:44 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 09:13:44 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 09:13:44 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 09:13:44 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 09:13:44 user nova-compute[72998]:       </nova:flavor>
Aug 17 09:13:44 user nova-compute[72998]:       <nova:owner>
Aug 17 09:13:44 user nova-compute[72998]:         <nova:user uuid="eeab5ccaa12540cf950a9461460cb6ae">tempest-TestVolumeBootPattern-496980120-project-member</nova:user>
Aug 17 09:13:44 user nova-compute[72998]:         <nova:project uuid="3e261c30b0a34357895224cf4772b371">tempest-TestVolumeBootPattern-496980120</nova:project>
Aug 17 09:13:44 user nova-compute[72998]:       </nova:owner>
Aug 17 09:13:44 user nova-compute[72998]:       <nova:ports>
Aug 17 09:13:44 user nova-compute[72998]:         <nova:port uuid="63b50546-146b-45b5-941a-0da4f9cc58e7">
Aug 17 09:13:44 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 09:13:44 user nova-compute[72998]:         </nova:port>
Aug 17 09:13:44 user nova-compute[72998]:       </nova:ports>
Aug 17 09:13:44 user nova-compute[72998]:     </nova:instance>
Aug 17 09:13:44 user nova-compute[72998]:   </metadata>
Aug 17 09:13:44 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 09:13:44 user nova-compute[72998]:     <system>
Aug 17 09:13:44 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 09:13:44 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 09:13:44 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 09:13:44 user nova-compute[72998]:       <entry name="serial">a7adc4b1-ecc8-431c-906d-5d197dd6289c</entry>
Aug 17 09:13:44 user nova-compute[72998]:       <entry name="uuid">a7adc4b1-ecc8-431c-906d-5d197dd6289c</entry>
Aug 17 09:13:44 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 09:13:44 user nova-compute[72998]:     </system>
Aug 17 09:13:44 user nova-compute[72998]:   </sysinfo>
Aug 17 09:13:44 user nova-compute[72998]:   <os>
Aug 17 09:13:44 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 09:13:44 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 09:13:44 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 09:13:44 user nova-compute[72998]:   </os>
Aug 17 09:13:44 user nova-compute[72998]:   <features>
Aug 17 09:13:44 user nova-compute[72998]:     <acpi/>
Aug 17 09:13:44 user nova-compute[72998]:     <apic/>
Aug 17 09:13:44 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 09:13:44 user nova-compute[72998]:   </features>
Aug 17 09:13:44 user nova-compute[72998]:   <clock offset="utc">
Aug 17 09:13:44 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 09:13:44 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 09:13:44 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 09:13:44 user nova-compute[72998]:   </clock>
Aug 17 09:13:44 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 09:13:44 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 09:13:44 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 09:13:44 user nova-compute[72998]:   </cpu>
Aug 17 09:13:44 user nova-compute[72998]:   <devices>
Aug 17 09:13:44 user nova-compute[72998]:     <disk type="block" device="disk">
Aug 17 09:13:44 user nova-compute[72998]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:13:44 user nova-compute[72998]:       <source dev="/dev/sdc"/>
Aug 17 09:13:44 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 09:13:44 user nova-compute[72998]:       <serial>565ed49e-03b6-4650-8ae4-34e21c1ca611</serial>
Aug 17 09:13:44 user nova-compute[72998]:     </disk>
Aug 17 09:13:44 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 09:13:44 user nova-compute[72998]:       <mac address="fa:16:3e:17:7e:e0"/>
Aug 17 09:13:44 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:13:44 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 09:13:44 user nova-compute[72998]:       <target dev="tap63b50546-14"/>
Aug 17 09:13:44 user nova-compute[72998]:     </interface>
Aug 17 09:13:44 user nova-compute[72998]:     <serial type="pty">
Aug 17 09:13:44 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/a7adc4b1-ecc8-431c-906d-5d197dd6289c/console.log" append="off"/>
Aug 17 09:13:44 user nova-compute[72998]:     </serial>
Aug 17 09:13:44 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 09:13:44 user nova-compute[72998]:     <video>
Aug 17 09:13:44 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:13:44 user nova-compute[72998]:     </video>
Aug 17 09:13:44 user nova-compute[72998]:     <rng model="virtio">
Aug 17 09:13:44 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 09:13:44 user nova-compute[72998]:     </rng>
Aug 17 09:13:44 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 09:13:44 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 09:13:44 user nova-compute[72998]:       <stats period="10"/>
Aug 17 09:13:44 user nova-compute[72998]:     </memballoon>
Aug 17 09:13:44 user nova-compute[72998]:   </devices>
Aug 17 09:13:44 user nova-compute[72998]: </domain>
Aug 17 09:13:44 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2064468254',display_name='tempest-TestVolumeBootPattern-server-2064468254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2064468254',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjTvZgPHFA5zBVDLHwQ6Ik5MpYZKcO/hQ32p5utozUsMbB3Fzp27hH7yFw7YeaiL3gq/7ZnzFRee+WqPWYMFQz72qtVyqekinvIoyNOitgO17CuXEPrxfvfZhU1aFHv1A==',key_name='tempest-TestVolumeBootPattern-347598242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-82l01jsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:13:32Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=a7adc4b1-ecc8-431c-906d-5d197dd6289c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7e:e0,bridge_name='br-int',has_traffic_filtering=True,id=63b50546-146b-45b5-941a-0da4f9cc58e7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b50546-14') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG os_vif [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7e:e0,bridge_name='br-int',has_traffic_filtering=True,id=63b50546-146b-45b5-941a-0da4f9cc58e7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b50546-14') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63b50546-14, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63b50546-14, col_values=(('external_ids', {'iface-id': '63b50546-146b-45b5-941a-0da4f9cc58e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:7e:e0', 'vm-uuid': 'a7adc4b1-ecc8-431c-906d-5d197dd6289c'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:44 user nova-compute[72998]: INFO os_vif [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7e:e0,bridge_name='br-int',has_traffic_filtering=True,id=63b50546-146b-45b5-941a-0da4f9cc58e7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b50546-14')
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:13:44 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] No VIF found with MAC fa:16:3e:17:7e:e0, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:13:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-52b98002-1100-4486-b560-c7f58ebf94d8 req-504e6c58-7557-4168-b872-60cd7116476b service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:13:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-52b98002-1100-4486-b560-c7f58ebf94d8 req-504e6c58-7557-4168-b872-60cd7116476b service nova] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:13:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-52b98002-1100-4486-b560-c7f58ebf94d8 req-504e6c58-7557-4168-b872-60cd7116476b service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:13:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-52b98002-1100-4486-b560-c7f58ebf94d8 req-504e6c58-7557-4168-b872-60cd7116476b service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:13:45 user nova-compute[72998]: DEBUG nova.compute.manager [req-52b98002-1100-4486-b560-c7f58ebf94d8 req-504e6c58-7557-4168-b872-60cd7116476b service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] No waiting events found dispatching network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:13:45 user nova-compute[72998]: WARNING nova.compute.manager [req-52b98002-1100-4486-b560-c7f58ebf94d8 req-504e6c58-7557-4168-b872-60cd7116476b service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received unexpected event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 for instance with vm_state building and task_state spawning.
Aug 17 09:13:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263627.8556173, a7adc4b1-ecc8-431c-906d-5d197dd6289c => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:13:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] VM Resumed (Lifecycle Event)
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 09:13:47 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Instance spawned successfully.
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:13:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263627.8567939, a7adc4b1-ecc8-431c-906d-5d197dd6289c => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:13:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] VM Started (Lifecycle Event)
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:13:47 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:13:47 user nova-compute[72998]: INFO nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Took 4.93 seconds to spawn the instance on the hypervisor.
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-f41812f6-82d4-4f5a-9271-fa4279ebab3b req-204ef6ab-d1ef-44c3-a628-14eb99511168 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f41812f6-82d4-4f5a-9271-fa4279ebab3b req-204ef6ab-d1ef-44c3-a628-14eb99511168 service nova] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f41812f6-82d4-4f5a-9271-fa4279ebab3b req-204ef6ab-d1ef-44c3-a628-14eb99511168 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f41812f6-82d4-4f5a-9271-fa4279ebab3b req-204ef6ab-d1ef-44c3-a628-14eb99511168 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:13:47 user nova-compute[72998]: DEBUG nova.compute.manager [req-f41812f6-82d4-4f5a-9271-fa4279ebab3b req-204ef6ab-d1ef-44c3-a628-14eb99511168 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] No waiting events found dispatching network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:13:47 user nova-compute[72998]: WARNING nova.compute.manager [req-f41812f6-82d4-4f5a-9271-fa4279ebab3b req-204ef6ab-d1ef-44c3-a628-14eb99511168 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received unexpected event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 for instance with vm_state building and task_state spawning.
Aug 17 09:13:48 user nova-compute[72998]: INFO nova.compute.manager [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Took 15.95 seconds to build instance.
Aug 17 09:13:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-947685f0-0158-4ec1-b7aa-a017c08079ed tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.053s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:13:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:51 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:13:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:13:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:13:52 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:13:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:13:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:13:53 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:13:53 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:13:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8759MB free_disk=24.05548095703125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a7adc4b1-ecc8-431c-906d-5d197dd6289c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:13:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:13:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:13:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:13:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:13:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:13:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:14:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:14:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:14:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:14:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:14:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:14:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:14:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:14:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:14:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:14:40 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updating instance_info_cache with network_info: [{"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:14:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:14:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:14:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:14:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:14:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:14:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:14:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:14:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:14:52 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:14:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:14:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:14:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:14:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:14:53 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:14:53 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:14:54 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:14:54 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:14:54 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.054779052734375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a7adc4b1-ecc8-431c-906d-5d197dd6289c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:14:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:14:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:14:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:14:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:14:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:15:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:15:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:15:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:15:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:23 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-8d6bc74b-c898-48b1-b0fb-b128710ec6c0 req-85948b18-2522-452e-8e3a-9574c4098e9b service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-changed-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-8d6bc74b-c898-48b1-b0fb-b128710ec6c0 req-85948b18-2522-452e-8e3a-9574c4098e9b service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Refreshing instance network info cache due to event network-changed-63b50546-146b-45b5-941a-0da4f9cc58e7. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d6bc74b-c898-48b1-b0fb-b128710ec6c0 req-85948b18-2522-452e-8e3a-9574c4098e9b service nova] Acquiring lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d6bc74b-c898-48b1-b0fb-b128710ec6c0 req-85948b18-2522-452e-8e3a-9574c4098e9b service nova] Acquired lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG nova.network.neutron [req-8d6bc74b-c898-48b1-b0fb-b128710ec6c0 req-85948b18-2522-452e-8e3a-9574c4098e9b service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Refreshing network info cache for port 63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG nova.network.neutron [req-8d6bc74b-c898-48b1-b0fb-b128710ec6c0 req-85948b18-2522-452e-8e3a-9574c4098e9b service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Updated VIF entry in instance network info cache for port 63b50546-146b-45b5-941a-0da4f9cc58e7. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG nova.network.neutron [req-8d6bc74b-c898-48b1-b0fb-b128710ec6c0 req-85948b18-2522-452e-8e3a-9574c4098e9b service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Updating instance_info_cache with network_info: [{"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-8d6bc74b-c898-48b1-b0fb-b128710ec6c0 req-85948b18-2522-452e-8e3a-9574c4098e9b service nova] Releasing lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-e02682e1-ffe2-4e71-8741-b1471e5052eb req-55498a62-61ad-48fb-b41f-702cf4d60a77 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-changed-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG nova.compute.manager [req-e02682e1-ffe2-4e71-8741-b1471e5052eb req-55498a62-61ad-48fb-b41f-702cf4d60a77 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Refreshing instance network info cache due to event network-changed-63b50546-146b-45b5-941a-0da4f9cc58e7. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e02682e1-ffe2-4e71-8741-b1471e5052eb req-55498a62-61ad-48fb-b41f-702cf4d60a77 service nova] Acquiring lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e02682e1-ffe2-4e71-8741-b1471e5052eb req-55498a62-61ad-48fb-b41f-702cf4d60a77 service nova] Acquired lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:15:24 user nova-compute[72998]: DEBUG nova.network.neutron [req-e02682e1-ffe2-4e71-8741-b1471e5052eb req-55498a62-61ad-48fb-b41f-702cf4d60a77 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Refreshing network info cache for port 63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:25 user nova-compute[72998]: INFO nova.compute.manager [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Terminating instance
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-ee83bede-4e33-4be1-a129-8377a1355545 req-670d4b40-c5fc-4605-8464-deb948f5ee6c service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-unplugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ee83bede-4e33-4be1-a129-8377a1355545 req-670d4b40-c5fc-4605-8464-deb948f5ee6c service nova] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ee83bede-4e33-4be1-a129-8377a1355545 req-670d4b40-c5fc-4605-8464-deb948f5ee6c service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-ee83bede-4e33-4be1-a129-8377a1355545 req-670d4b40-c5fc-4605-8464-deb948f5ee6c service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-ee83bede-4e33-4be1-a129-8377a1355545 req-670d4b40-c5fc-4605-8464-deb948f5ee6c service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] No waiting events found dispatching network-vif-unplugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-ee83bede-4e33-4be1-a129-8377a1355545 req-670d4b40-c5fc-4605-8464-deb948f5ee6c service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-unplugged-63b50546-146b-45b5-941a-0da4f9cc58e7 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.network.neutron [req-e02682e1-ffe2-4e71-8741-b1471e5052eb req-55498a62-61ad-48fb-b41f-702cf4d60a77 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Updated VIF entry in instance network info cache for port 63b50546-146b-45b5-941a-0da4f9cc58e7. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.network.neutron [req-e02682e1-ffe2-4e71-8741-b1471e5052eb req-55498a62-61ad-48fb-b41f-702cf4d60a77 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Updating instance_info_cache with network_info: [{"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-e02682e1-ffe2-4e71-8741-b1471e5052eb req-55498a62-61ad-48fb-b41f-702cf4d60a77 service nova] Releasing lock "refresh_cache-a7adc4b1-ecc8-431c-906d-5d197dd6289c" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Instance destroyed successfully.
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'resources' on Instance uuid a7adc4b1-ecc8-431c-906d-5d197dd6289c {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2064468254',display_name='tempest-TestVolumeBootPattern-server-2064468254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2064468254',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjTvZgPHFA5zBVDLHwQ6Ik5MpYZKcO/hQ32p5utozUsMbB3Fzp27hH7yFw7YeaiL3gq/7ZnzFRee+WqPWYMFQz72qtVyqekinvIoyNOitgO17CuXEPrxfvfZhU1aFHv1A==',key_name='tempest-TestVolumeBootPattern-347598242',keypairs=<?>,launch_index=0,launched_at=2023-08-17T09:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-82l01jsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T09:13:48Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=a7adc4b1-ecc8-431c-906d-5d197dd6289c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "63b50546-146b-45b5-941a-0da4f9cc58e7", "address": "fa:16:3e:17:7e:e0", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b50546-14", "ovs_interfaceid": "63b50546-146b-45b5-941a-0da4f9cc58e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:7e:e0,bridge_name='br-int',has_traffic_filtering=True,id=63b50546-146b-45b5-941a-0da4f9cc58e7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b50546-14') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_vif [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:7e:e0,bridge_name='br-int',has_traffic_filtering=True,id=63b50546-146b-45b5-941a-0da4f9cc58e7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b50546-14') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63b50546-14, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:25 user nova-compute[72998]: INFO os_vif [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:7e:e0,bridge_name='br-int',has_traffic_filtering=True,id=63b50546-146b-45b5-941a-0da4f9cc58e7,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b50546-14')
Aug 17 09:15:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxZJwIMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:15:25 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0006ea34-d065-4fad-a9d9-00fafebb0334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6f62a4-de8c-42b1-b975-f0912a0d6f48]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:15:25 user nova-compute[72998]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 (non-flash)
Aug 17 09:15:25 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:15:25 user nova-compute[72998]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 (non-flash)
Aug 17 09:15:25 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488574e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611'): ({'sdc'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Removing single pathed devices sdc {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aca56e-cbb6-41ed-9ec3-32613f4f27f6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb82b14-f49a-400c-a713-89b3b8ad5b3f]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flushing IO for device /dev/sdc {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c1982-21eb-4720-bb72-4a661d309112]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:25 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[639f9c85-bbe1-4382-ae63-9df6e2884827]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] SCSI volumes sdc have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_536c6376', '/dev/disk/by-id/scsi-23234303831373433', '/dev/disk/by-id/scsi-1SCST_BIO536c6376-24081743978a2896') {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec13475-ef42-43d3-9c39-0724dd5c5b9a]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee91f74-a024-4882-a033-896a9e9a1949]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b6b78c-3b5c-4215-a8f9-309a22587ede]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611, portal: 172.16.0.220,3260]
Aug 17 09:15:26 user nova-compute[72998]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611, portal: 172.16.0.220,3260] successful.
Aug 17 09:15:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:565ed49e-03b6-4650-8ae4-34e21c1ca611 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f6710a-8ed3-4ea0-b515-22eb97975366]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== disconnect_volume: return (304ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:15:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Deleting instance files /opt/stack/data/nova/instances/a7adc4b1-ecc8-431c-906d-5d197dd6289c_del
Aug 17 09:15:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Deletion of /opt/stack/data/nova/instances/a7adc4b1-ecc8-431c-906d-5d197dd6289c_del complete
Aug 17 09:15:26 user nova-compute[72998]: INFO nova.compute.manager [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 17 09:15:26 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 09:15:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:15:27 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Took 0.86 seconds to deallocate network for instance.
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] No waiting events found dispatching network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:15:27 user nova-compute[72998]: WARNING nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received unexpected event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 for instance with vm_state active and task_state deleting.
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] No waiting events found dispatching network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:15:27 user nova-compute[72998]: WARNING nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received unexpected event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 for instance with vm_state active and task_state deleting.
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] No waiting events found dispatching network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:15:27 user nova-compute[72998]: WARNING nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received unexpected event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 for instance with vm_state active and task_state deleting.
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-unplugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] No waiting events found dispatching network-vif-unplugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-unplugged-63b50546-146b-45b5-941a-0da4f9cc58e7 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Acquiring lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] No waiting events found dispatching network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:15:27 user nova-compute[72998]: WARNING nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received unexpected event network-vif-plugged-63b50546-146b-45b5-941a-0da4f9cc58e7 for instance with vm_state active and task_state deleting.
Aug 17 09:15:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-f6eea605-3ea5-4599-96a9-51e8bbd69668 req-c0876053-754a-4cb0-bb41-3f54ff958150 service nova] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Received event network-vif-deleted-63b50546-146b-45b5-941a-0da4f9cc58e7 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:15:27 user nova-compute[72998]: INFO nova.compute.manager [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Took 0.79 seconds to detach 1 volumes for instance.
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:28 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:15:28 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:15:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:28 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Deleted allocations for instance a7adc4b1-ecc8-431c-906d-5d197dd6289c
Aug 17 09:15:28 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-91b2fae3-c05b-4a74-a20f-b817430b6bf1 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "a7adc4b1-ecc8-431c-906d-5d197dd6289c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.123s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:39 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:15:39 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:15:40 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692263725.8129776, a7adc4b1-ecc8-431c-906d-5d197dd6289c => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:15:40 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] VM Stopped (Lifecycle Event)
Aug 17 09:15:40 user nova-compute[72998]: DEBUG nova.compute.manager [None req-53af6e93-5a5e-4270-9241-8234630abc28 None None] [instance: a7adc4b1-ecc8-431c-906d-5d197dd6289c] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:15:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:15:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:15:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:15:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:51 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:54 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:15:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:15:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:15:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=24.053813934326172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:15:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:15:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:15:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:16:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 09:16:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 09:16:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 09:16:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:16:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:16:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:16:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:16:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-21a3e89d-2951-4654-928a-e3da754a0260 req-e0b27a55-2cd1-44ee-ac06-b15597a3e54b service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received event network-changed-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-21a3e89d-2951-4654-928a-e3da754a0260 req-e0b27a55-2cd1-44ee-ac06-b15597a3e54b service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Refreshing instance network info cache due to event network-changed-0425f39c-8a67-4ca6-b524-6e6b1c162c99. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-21a3e89d-2951-4654-928a-e3da754a0260 req-e0b27a55-2cd1-44ee-ac06-b15597a3e54b service nova] Acquiring lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-21a3e89d-2951-4654-928a-e3da754a0260 req-e0b27a55-2cd1-44ee-ac06-b15597a3e54b service nova] Acquired lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-21a3e89d-2951-4654-928a-e3da754a0260 req-e0b27a55-2cd1-44ee-ac06-b15597a3e54b service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Refreshing network info cache for port 0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:16:35 user nova-compute[72998]: INFO nova.compute.manager [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Terminating instance
Aug 17 09:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-3dcf6e5a-7c3b-488d-8999-1c87a9278cbb req-5024c67f-7d92-4d2c-bdf6-af8623a869d2 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received event network-vif-unplugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3dcf6e5a-7c3b-488d-8999-1c87a9278cbb req-5024c67f-7d92-4d2c-bdf6-af8623a869d2 service nova] Acquiring lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3dcf6e5a-7c3b-488d-8999-1c87a9278cbb req-5024c67f-7d92-4d2c-bdf6-af8623a869d2 service nova] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-3dcf6e5a-7c3b-488d-8999-1c87a9278cbb req-5024c67f-7d92-4d2c-bdf6-af8623a869d2 service nova] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-3dcf6e5a-7c3b-488d-8999-1c87a9278cbb req-5024c67f-7d92-4d2c-bdf6-af8623a869d2 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] No waiting events found dispatching network-vif-unplugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG nova.compute.manager [req-3dcf6e5a-7c3b-488d-8999-1c87a9278cbb req-5024c67f-7d92-4d2c-bdf6-af8623a869d2 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received event network-vif-unplugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-21a3e89d-2951-4654-928a-e3da754a0260 req-e0b27a55-2cd1-44ee-ac06-b15597a3e54b service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updated VIF entry in instance network info cache for port 0425f39c-8a67-4ca6-b524-6e6b1c162c99. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG nova.network.neutron [req-21a3e89d-2951-4654-928a-e3da754a0260 req-e0b27a55-2cd1-44ee-ac06-b15597a3e54b service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updating instance_info_cache with network_info: [{"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:16:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-21a3e89d-2951-4654-928a-e3da754a0260 req-e0b27a55-2cd1-44ee-ac06-b15597a3e54b service nova] Releasing lock "refresh_cache-c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:16:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Instance destroyed successfully.
Aug 17 09:16:36 user nova-compute[72998]: DEBUG nova.objects.instance [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lazy-loading 'resources' on Instance uuid c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1941328574',display_name='tempest-TestVolumeBootPattern-server-1941328574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1941328574',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjTvZgPHFA5zBVDLHwQ6Ik5MpYZKcO/hQ32p5utozUsMbB3Fzp27hH7yFw7YeaiL3gq/7ZnzFRee+WqPWYMFQz72qtVyqekinvIoyNOitgO17CuXEPrxfvfZhU1aFHv1A==',key_name='tempest-TestVolumeBootPattern-347598242',keypairs=<?>,launch_index=0,launched_at=2023-08-17T09:11:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e261c30b0a34357895224cf4772b371',ramdisk_id='',reservation_id='r-4bl76z2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-496980120',owner_user_name='tempest-TestVolumeBootPattern-496980120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T09:11:41Z,user_data=None,user_id='eeab5ccaa12540cf950a9461460cb6ae',uuid=c0aa43fe-1379-4f4e-b08e-08c3e671f3f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converting VIF {"id": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "address": "fa:16:3e:e2:40:1e", "network": {"id": "107278c6-d99e-42e4-bb75-d42647acb9f5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1899100458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e261c30b0a34357895224cf4772b371", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0425f39c-8a", "ovs_interfaceid": "0425f39c-8a67-4ca6-b524-6e6b1c162c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=0425f39c-8a67-4ca6-b524-6e6b1c162c99,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0425f39c-8a') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_vif [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=0425f39c-8a67-4ca6-b524-6e6b1c162c99,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0425f39c-8a') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0425f39c-8a, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:16:36 user nova-compute[72998]: INFO os_vif [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=0425f39c-8a67-4ca6-b524-6e6b1c162c99,network=Network(107278c6-d99e-42e4-bb75-d42647acb9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0425f39c-8a')
Aug 17 09:16:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGKychbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:16:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4794d23a-385b-4936-96cb-4896a678d06d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[af28a8c9-3e15-43db-8a45-7cd8f2e5b0e4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:16:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a (non-flash)
Aug 17 09:16:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488269990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad08efe-888a-4fdd-b8bc-eaf9a4c2dd1d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[62958340-c55a-48de-8161-8ce2e554dd37]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c634e6c-bd4d-4c80-9d3d-f16b13ef68bf]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[01482091-a742-4f23-bfbc-b749a21c85c7]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23665303162336239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_edc2597a', '/dev/disk/by-id/scsi-1SCST_BIOedc2597a-6e01b3b9c6a22b0b') {{(pid=84658) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeff083-67c4-41e1-a030-41263e9d6219]: (4, None) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4962de-f6ad-4c95-94c3-0fb6164c5598]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8048506-89ad-429d-a54b-1d6f28acbf9c]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260]
Aug 17 09:16:36 user nova-compute[72998]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a, portal: 172.16.0.220,3260] successful.
Aug 17 09:16:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7d15e89-923e-4cb1-a9dd-9bbe3057d21a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25b4d2c-8bb3-4586-933a-782455b3f8d9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] <== disconnect_volume: return (290ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:16:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Deleting instance files /opt/stack/data/nova/instances/c0aa43fe-1379-4f4e-b08e-08c3e671f3f2_del
Aug 17 09:16:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Deletion of /opt/stack/data/nova/instances/c0aa43fe-1379-4f4e-b08e-08c3e671f3f2_del complete
Aug 17 09:16:36 user nova-compute[72998]: INFO nova.compute.manager [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 17 09:16:36 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 09:16:36 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 09:16:37 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:16:37 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Took 0.47 seconds to deallocate network for instance.
Aug 17 09:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-6850a87e-9ea6-4b0d-97ed-9ecac6d57298 req-026a7388-00ee-4273-8b09-b14995fa430d service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received event network-vif-deleted-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:16:37 user nova-compute[72998]: INFO nova.compute.manager [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 09:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-a55de456-54b5-4d4b-8017-a298d0371f26 req-503ac76e-0105-42f5-afb8-54bdf5389d86 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received event network-vif-plugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a55de456-54b5-4d4b-8017-a298d0371f26 req-503ac76e-0105-42f5-afb8-54bdf5389d86 service nova] Acquiring lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a55de456-54b5-4d4b-8017-a298d0371f26 req-503ac76e-0105-42f5-afb8-54bdf5389d86 service nova] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a55de456-54b5-4d4b-8017-a298d0371f26 req-503ac76e-0105-42f5-afb8-54bdf5389d86 service nova] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:16:37 user nova-compute[72998]: DEBUG nova.compute.manager [req-a55de456-54b5-4d4b-8017-a298d0371f26 req-503ac76e-0105-42f5-afb8-54bdf5389d86 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] No waiting events found dispatching network-vif-plugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:16:37 user nova-compute[72998]: WARNING nova.compute.manager [req-a55de456-54b5-4d4b-8017-a298d0371f26 req-503ac76e-0105-42f5-afb8-54bdf5389d86 service nova] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Received unexpected event network-vif-plugged-0425f39c-8a67-4ca6-b524-6e6b1c162c99 for instance with vm_state active and task_state deleting.
Aug 17 09:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:16:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:16:38 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:16:38 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:16:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:16:38 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Deleted allocations for instance c0aa43fe-1379-4f4e-b08e-08c3e671f3f2
Aug 17 09:16:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-7762808b-974b-4f28-8232-db16130dd904 tempest-TestVolumeBootPattern-496980120 tempest-TestVolumeBootPattern-496980120-project-member] Lock "c0aa43fe-1379-4f4e-b08e-08c3e671f3f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.678s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:16:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:16:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:16:41 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:16:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:16:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:16:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:16:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:16:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:51 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692263796.2582052, c0aa43fe-1379-4f4e-b08e-08c3e671f3f2 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:16:51 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] VM Stopped (Lifecycle Event)
Aug 17 09:16:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-3e5bf438-23c2-4d9f-a3ba-55488a2e5ec6 None None] [instance: c0aa43fe-1379-4f4e-b08e-08c3e671f3f2] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:16:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:16:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:16:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:16:55 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:16:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:16:56 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:16:56 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=24.052871704101562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:16:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:16:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:16:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:17:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:17:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:17:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:17:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:17:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:17:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:17:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:17:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:17:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:17:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:17:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:17:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:17:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:17:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:17:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:17:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:17:42 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:17:42 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:17:42 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:17:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:48 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:17:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:17:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:17:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:17:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:17:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:17:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:17:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:17:57 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:17:58 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:17:58 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=24.05056381225586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 09:17:58 user nova-compute[72998]: INFO nova.compute.claims [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Claim successful on node user
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 09:17:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 09:17:58 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 09:17:59 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Creating image(s)
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "/opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "/opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.policy [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c37152cb2e54db0b14343c3e482b283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa011e0392f8475890e8356d3dbbde72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.175s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk 1073741824" returned: 0 in 0.053s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Successfully created port: 8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Cannot resize image /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.objects.instance [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'migration_context' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Ensure instance console log exists: /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:17:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Successfully updated port: 8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-66300d0b-a337-4751-a556-0b8538bc9293 req-14819ac5-959e-4119-921f-0e8be409da5c service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received event network-changed-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.compute.manager [req-66300d0b-a337-4751-a556-0b8538bc9293 req-14819ac5-959e-4119-921f-0e8be409da5c service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Refreshing instance network info cache due to event network-changed-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-66300d0b-a337-4751-a556-0b8538bc9293 req-14819ac5-959e-4119-921f-0e8be409da5c service nova] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Instance network_info: |[{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-66300d0b-a337-4751-a556-0b8538bc9293 req-14819ac5-959e-4119-921f-0e8be409da5c service nova] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.network.neutron [req-66300d0b-a337-4751-a556-0b8538bc9293 req-14819ac5-959e-4119-921f-0e8be409da5c service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Refreshing network info cache for port 8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Start _get_guest_xml network_info=[{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 09:18:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:18:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 09:18:00 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2146624845',display_name='tempest-SnapshotDataIntegrityTests-server-2146624845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2146624845',id=52,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmJ0X7xp9ihaCPzV16EZUoqUMyNeKgWnfL12/kxJUrwlJGbbQQOCiikRDaSE3KdW5uUA30VYg0OkgMM1OyZlEzwYJv6TjgmS13QmVGKF/hGTlQCrSPjtmnLRhKyKh/2Nw==',key_name='tempest-keypair-642266717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa011e0392f8475890e8356d3dbbde72',ramdisk_id='',reservation_id='r-575073vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-306227939',owner_user_name='tempest-SnapshotDataIntegrityTests-306227939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c37152cb2e54db0b14343c3e482b283',uuid=a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Converting VIF {"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:60:c8,bridge_name='br-int',has_traffic_filtering=True,id=8f2b74f9-ad5f-47c7-8fa2-40477e3f0080,network=Network(220cacf5-12aa-4250-990a-ddbf1f4c9a90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2b74f9-ad') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'pci_devices' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] End _get_guest_xml xml=<domain type="kvm">
Aug 17 09:18:01 user nova-compute[72998]:   <uuid>a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc</uuid>
Aug 17 09:18:01 user nova-compute[72998]:   <name>instance-00000034</name>
Aug 17 09:18:01 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 09:18:01 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 09:18:01 user nova-compute[72998]:   <metadata>
Aug 17 09:18:01 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 09:18:01 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 09:18:01 user nova-compute[72998]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2146624845</nova:name>
Aug 17 09:18:01 user nova-compute[72998]:       <nova:creationTime>2023-08-17 09:18:00</nova:creationTime>
Aug 17 09:18:01 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 09:18:01 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 09:18:01 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 09:18:01 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 09:18:01 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 09:18:01 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 09:18:01 user nova-compute[72998]:       </nova:flavor>
Aug 17 09:18:01 user nova-compute[72998]:       <nova:owner>
Aug 17 09:18:01 user nova-compute[72998]:         <nova:user uuid="4c37152cb2e54db0b14343c3e482b283">tempest-SnapshotDataIntegrityTests-306227939-project-member</nova:user>
Aug 17 09:18:01 user nova-compute[72998]:         <nova:project uuid="aa011e0392f8475890e8356d3dbbde72">tempest-SnapshotDataIntegrityTests-306227939</nova:project>
Aug 17 09:18:01 user nova-compute[72998]:       </nova:owner>
Aug 17 09:18:01 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 09:18:01 user nova-compute[72998]:       <nova:ports>
Aug 17 09:18:01 user nova-compute[72998]:         <nova:port uuid="8f2b74f9-ad5f-47c7-8fa2-40477e3f0080">
Aug 17 09:18:01 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 09:18:01 user nova-compute[72998]:         </nova:port>
Aug 17 09:18:01 user nova-compute[72998]:       </nova:ports>
Aug 17 09:18:01 user nova-compute[72998]:     </nova:instance>
Aug 17 09:18:01 user nova-compute[72998]:   </metadata>
Aug 17 09:18:01 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 09:18:01 user nova-compute[72998]:     <system>
Aug 17 09:18:01 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 09:18:01 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 09:18:01 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 09:18:01 user nova-compute[72998]:       <entry name="serial">a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc</entry>
Aug 17 09:18:01 user nova-compute[72998]:       <entry name="uuid">a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc</entry>
Aug 17 09:18:01 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 09:18:01 user nova-compute[72998]:     </system>
Aug 17 09:18:01 user nova-compute[72998]:   </sysinfo>
Aug 17 09:18:01 user nova-compute[72998]:   <os>
Aug 17 09:18:01 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 09:18:01 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 09:18:01 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 09:18:01 user nova-compute[72998]:   </os>
Aug 17 09:18:01 user nova-compute[72998]:   <features>
Aug 17 09:18:01 user nova-compute[72998]:     <acpi/>
Aug 17 09:18:01 user nova-compute[72998]:     <apic/>
Aug 17 09:18:01 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 09:18:01 user nova-compute[72998]:   </features>
Aug 17 09:18:01 user nova-compute[72998]:   <clock offset="utc">
Aug 17 09:18:01 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 09:18:01 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 09:18:01 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 09:18:01 user nova-compute[72998]:   </clock>
Aug 17 09:18:01 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 09:18:01 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 09:18:01 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 09:18:01 user nova-compute[72998]:   </cpu>
Aug 17 09:18:01 user nova-compute[72998]:   <devices>
Aug 17 09:18:01 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 09:18:01 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 09:18:01 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk"/>
Aug 17 09:18:01 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 09:18:01 user nova-compute[72998]:     </disk>
Aug 17 09:18:01 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 09:18:01 user nova-compute[72998]:       <mac address="fa:16:3e:e1:60:c8"/>
Aug 17 09:18:01 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:18:01 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 09:18:01 user nova-compute[72998]:       <target dev="tap8f2b74f9-ad"/>
Aug 17 09:18:01 user nova-compute[72998]:     </interface>
Aug 17 09:18:01 user nova-compute[72998]:     <serial type="pty">
Aug 17 09:18:01 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/console.log" append="off"/>
Aug 17 09:18:01 user nova-compute[72998]:     </serial>
Aug 17 09:18:01 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 09:18:01 user nova-compute[72998]:     <video>
Aug 17 09:18:01 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:18:01 user nova-compute[72998]:     </video>
Aug 17 09:18:01 user nova-compute[72998]:     <rng model="virtio">
Aug 17 09:18:01 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 09:18:01 user nova-compute[72998]:     </rng>
Aug 17 09:18:01 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 09:18:01 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 09:18:01 user nova-compute[72998]:       <stats period="10"/>
Aug 17 09:18:01 user nova-compute[72998]:     </memballoon>
Aug 17 09:18:01 user nova-compute[72998]:   </devices>
Aug 17 09:18:01 user nova-compute[72998]: </domain>
Aug 17 09:18:01 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2146624845',display_name='tempest-SnapshotDataIntegrityTests-server-2146624845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2146624845',id=52,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmJ0X7xp9ihaCPzV16EZUoqUMyNeKgWnfL12/kxJUrwlJGbbQQOCiikRDaSE3KdW5uUA30VYg0OkgMM1OyZlEzwYJv6TjgmS13QmVGKF/hGTlQCrSPjtmnLRhKyKh/2Nw==',key_name='tempest-keypair-642266717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa011e0392f8475890e8356d3dbbde72',ramdisk_id='',reservation_id='r-575073vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-306227939',owner_user_name='tempest-SnapshotDataIntegrityTests-306227939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c37152cb2e54db0b14343c3e482b283',uuid=a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Converting VIF {"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:60:c8,bridge_name='br-int',has_traffic_filtering=True,id=8f2b74f9-ad5f-47c7-8fa2-40477e3f0080,network=Network(220cacf5-12aa-4250-990a-ddbf1f4c9a90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2b74f9-ad') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG os_vif [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:60:c8,bridge_name='br-int',has_traffic_filtering=True,id=8f2b74f9-ad5f-47c7-8fa2-40477e3f0080,network=Network(220cacf5-12aa-4250-990a-ddbf1f4c9a90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2b74f9-ad') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f2b74f9-ad, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f2b74f9-ad, col_values=(('external_ids', {'iface-id': '8f2b74f9-ad5f-47c7-8fa2-40477e3f0080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:60:c8', 'vm-uuid': 'a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:01 user nova-compute[72998]: INFO os_vif [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:60:c8,bridge_name='br-int',has_traffic_filtering=True,id=8f2b74f9-ad5f-47c7-8fa2-40477e3f0080,network=Network(220cacf5-12aa-4250-990a-ddbf1f4c9a90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2b74f9-ad')
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No VIF found with MAC fa:16:3e:e1:60:c8, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.network.neutron [req-66300d0b-a337-4751-a556-0b8538bc9293 req-14819ac5-959e-4119-921f-0e8be409da5c service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updated VIF entry in instance network info cache for port 8f2b74f9-ad5f-47c7-8fa2-40477e3f0080. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG nova.network.neutron [req-66300d0b-a337-4751-a556-0b8538bc9293 req-14819ac5-959e-4119-921f-0e8be409da5c service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:18:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-66300d0b-a337-4751-a556-0b8538bc9293 req-14819ac5-959e-4119-921f-0e8be409da5c service nova] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fec2e35-d62e-41f9-b3e8-af707790eebc req-d32eef32-7cb2-4308-8ced-20c7291d2350 service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received event network-vif-plugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fec2e35-d62e-41f9-b3e8-af707790eebc req-d32eef32-7cb2-4308-8ced-20c7291d2350 service nova] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fec2e35-d62e-41f9-b3e8-af707790eebc req-d32eef32-7cb2-4308-8ced-20c7291d2350 service nova] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6fec2e35-d62e-41f9-b3e8-af707790eebc req-d32eef32-7cb2-4308-8ced-20c7291d2350 service nova] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:18:02 user nova-compute[72998]: DEBUG nova.compute.manager [req-6fec2e35-d62e-41f9-b3e8-af707790eebc req-d32eef32-7cb2-4308-8ced-20c7291d2350 service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] No waiting events found dispatching network-vif-plugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:18:02 user nova-compute[72998]: WARNING nova.compute.manager [req-6fec2e35-d62e-41f9-b3e8-af707790eebc req-d32eef32-7cb2-4308-8ced-20c7291d2350 service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received unexpected event network-vif-plugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 for instance with vm_state building and task_state spawning.
Aug 17 09:18:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:03 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:18:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263884.4368014, a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:18:04 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] VM Resumed (Lifecycle Event)
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 09:18:04 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Instance spawned successfully.
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:18:04 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692263884.438629, a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:18:04 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] VM Started (Lifecycle Event)
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:18:04 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:18:04 user nova-compute[72998]: INFO nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-52dd0b6c-b8a1-49b2-8225-1187bd8f8b9c req-e02e9551-4d29-43bd-95a8-1ec6b4e26769 service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received event network-vif-plugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-52dd0b6c-b8a1-49b2-8225-1187bd8f8b9c req-e02e9551-4d29-43bd-95a8-1ec6b4e26769 service nova] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-52dd0b6c-b8a1-49b2-8225-1187bd8f8b9c req-e02e9551-4d29-43bd-95a8-1ec6b4e26769 service nova] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-52dd0b6c-b8a1-49b2-8225-1187bd8f8b9c req-e02e9551-4d29-43bd-95a8-1ec6b4e26769 service nova] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:18:04 user nova-compute[72998]: DEBUG nova.compute.manager [req-52dd0b6c-b8a1-49b2-8225-1187bd8f8b9c req-e02e9551-4d29-43bd-95a8-1ec6b4e26769 service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] No waiting events found dispatching network-vif-plugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:18:04 user nova-compute[72998]: WARNING nova.compute.manager [req-52dd0b6c-b8a1-49b2-8225-1187bd8f8b9c req-e02e9551-4d29-43bd-95a8-1ec6b4e26769 service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received unexpected event network-vif-plugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 for instance with vm_state active and task_state None.
Aug 17 09:18:04 user nova-compute[72998]: INFO nova.compute.manager [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Took 5.92 seconds to build instance.
Aug 17 09:18:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ec962f04-31a0-4292-8532-ac53a4828c85 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.032s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:18:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:18:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:18:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:18:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:18:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:18:43 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:18:43 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:18:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:18:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:18:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:18:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:18:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:18:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:18:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:18:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:18:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:18:56 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:18:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:18:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:18:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:18:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:18:57 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:18:57 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:18:58 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:18:58 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:18:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=24.013240814208984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:18:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:18:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:18:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:19:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:19:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:19:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:19:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:19:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:19:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:19:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:19:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:19:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:19:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:19:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:19:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:19:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:19:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:19:43 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:19:43 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:19:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:19:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:19:43 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:19:43 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:19:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:19:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:19:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:19:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:19:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-6c3cafe4-2ff7-418a-9221-d8157283b02e req-786a42a0-1211-452d-87f0-332f1f3e621e service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received event network-changed-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:19:49 user nova-compute[72998]: DEBUG nova.compute.manager [req-6c3cafe4-2ff7-418a-9221-d8157283b02e req-786a42a0-1211-452d-87f0-332f1f3e621e service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Refreshing instance network info cache due to event network-changed-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:19:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6c3cafe4-2ff7-418a-9221-d8157283b02e req-786a42a0-1211-452d-87f0-332f1f3e621e service nova] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:19:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6c3cafe4-2ff7-418a-9221-d8157283b02e req-786a42a0-1211-452d-87f0-332f1f3e621e service nova] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:19:49 user nova-compute[72998]: DEBUG nova.network.neutron [req-6c3cafe4-2ff7-418a-9221-d8157283b02e req-786a42a0-1211-452d-87f0-332f1f3e621e service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Refreshing network info cache for port 8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:19:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-6c3cafe4-2ff7-418a-9221-d8157283b02e req-786a42a0-1211-452d-87f0-332f1f3e621e service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updated VIF entry in instance network info cache for port 8f2b74f9-ad5f-47c7-8fa2-40477e3f0080. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:19:50 user nova-compute[72998]: DEBUG nova.network.neutron [req-6c3cafe4-2ff7-418a-9221-d8157283b02e req-786a42a0-1211-452d-87f0-332f1f3e621e service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:19:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-6c3cafe4-2ff7-418a-9221-d8157283b02e req-786a42a0-1211-452d-87f0-332f1f3e621e service nova] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:19:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:19:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:19:55 user nova-compute[72998]: INFO nova.compute.manager [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attaching volume dac727f4-5a51-43cf-9b1e-b1b5ce391571 to /dev/vdb
Aug 17 09:19:55 user nova-compute[72998]: DEBUG os_brick.utils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f848a07-fcc7-4342-8889-d9b98d7e5e4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d459fd92-7eaa-4fd0-a6cc-437fda99ad06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3d71c9-6637-4d93-b7a0-83c953576383]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5cd498-9309-47bf-8024-5edc21846f6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:19:55 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:19:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[082ec926-212d-4aa0-8cdb-6f8e323a1ebc]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG os_brick.utils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:19:55 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating existing volume attachment record: e9eda65e-4de8-49d8-8c1b-9d404f575608 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:19:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:19:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:19:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:19:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:19:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:19:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:19:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:19:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:19:59 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:19:59 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:19:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=24.012374877929688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:19:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:20:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:20:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:20:03 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:20:03 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:20:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlGUAOPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:20:05 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:20:05 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:20:05 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[81deb6e6-d9a5-488b-bab7-f8c555726cc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:20:05 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c51077-7e10-4dd8-b829-ebb17d86005e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571] added
Aug 17 09:20:05 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2d4314-0095-41f8-8ea5-7e8684d63fb9]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f51d65-167a-4575-aefd-7c24095b437d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlGUAOPp {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlGUAOPp" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6998323-0a24-472b-991b-3e65edc3499b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XlGUAOPp'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e177deb3-7d28-4855-9eb0-0e95aa931816]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af3a207-0bfd-47e7-bbd0-1a5d84e1052b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:20:05 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:20:05 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:20:05 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:20:05 user nova-compute[72998]: 
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d48032-28e1-4b9f-9298-aab5f0b5b619]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571, portal: 172.16.0.220,3260]
Aug 17 09:20:05 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571, portal: 172.16.0.220,3260] successful.
Aug 17 09:20:05 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d195b214-64f0-42a0-b367-39539e837b77]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dcc035-ae6a-48bf-ac68-a24b545b5506]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 (non-flash)
Aug 17 09:20:05 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 (non-flash)
Aug 17 09:20:05 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a8012-4b46-4e0d-abde-e0a36ea3c924]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:05 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:20:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:20:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:20:06 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:20:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlGUAOPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:20:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:20:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26431366264663962', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:20:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431366264663962', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:20:06 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:20:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 09:20:07 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:20:07 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:20:07 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:20:07 user nova-compute[72998]:   <serial>dac727f4-5a51-43cf-9b1e-b1b5ce391571</serial>
Aug 17 09:20:07 user nova-compute[72998]: </disk>
Aug 17 09:20:07 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 09:20:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:20:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:20:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No VIF found with MAC fa:16:3e:e1:60:c8, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:20:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f173925b-7c53-4cc9-a373-fd096203f799 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.313s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:20:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:20:36 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:20:36 user nova-compute[72998]: INFO nova.compute.manager [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Detaching volume dac727f4-5a51-43cf-9b1e-b1b5ce391571
Aug 17 09:20:36 user nova-compute[72998]: INFO nova.virt.block_device [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attempting to driver detach volume dac727f4-5a51-43cf-9b1e-b1b5ce391571 from mountpoint /dev/vdb
Aug 17 09:20:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Attempting to detach device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 09:20:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:20:36 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:20:36 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:20:36 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:20:36 user nova-compute[72998]:   <serial>dac727f4-5a51-43cf-9b1e-b1b5ce391571</serial>
Aug 17 09:20:36 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:20:36 user nova-compute[72998]: </disk>
Aug 17 09:20:36 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:20:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully detached device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the persistent domain config.
Aug 17 09:20:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 09:20:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:20:36 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:20:36 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:20:36 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:20:36 user nova-compute[72998]:   <serial>dac727f4-5a51-43cf-9b1e-b1b5ce391571</serial>
Aug 17 09:20:36 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:20:36 user nova-compute[72998]: </disk>
Aug 17 09:20:36 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692264037.4648402, a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 09:20:37 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully detached device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the live domain config.
Aug 17 09:20:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlGUAOPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:20:37 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afc22b5-d8d1-4bf1-8441-666cf044a2ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e5c302-3a05-4ccd-894a-a7405fac671d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 (non-flash)
Aug 17 09:20:37 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 (non-flash)
Aug 17 09:20:37 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464b9e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6f2fa5-1532-4d84-87cc-4a8105d927fe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8510dad2-a587-400c-a4c1-b4e629bcf4a2]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9894158f-16b8-447d-9fff-c53658bfff71]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e14c31-d902-44c0-805a-76ae69deba2c]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bfc738-e871-46ba-8199-339473760490]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd43525-fbc3-4de8-986e-22eb10d74caa]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571, portal: 172.16.0.220,3260]
Aug 17 09:20:37 user nova-compute[72998]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571, portal: 172.16.0.220,3260] successful.
Aug 17 09:20:37 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dac727f4-5a51-43cf-9b1e-b1b5ce391571 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[76702dcb-d17f-47f8-a007-2e4f97afe6e6]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== disconnect_volume: return (263ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:20:37 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:20:38 user nova-compute[72998]: DEBUG nova.objects.instance [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:20:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-260cd7ab-082b-46d4-b9ad-d5640e0a16bc tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:20:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:44 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:20:44 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:20:44 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:20:44 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:20:44 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:20:45 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:20:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:20:45 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:20:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:20:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:20:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:20:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:20:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:20:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:20:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:20:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:20:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:20:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:20:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:20:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:20:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:20:59 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:20:59 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=24.01123809814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:20:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:21:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:21:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:04 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:21:05 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:05 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:21:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 09:21:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 09:21:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:21:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 09:21:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:21:26 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:21:31 user nova-compute[72998]: INFO nova.compute.manager [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attaching volume 78181fdf-4cd9-4a17-9613-68f582abf5b9 to /dev/vdb
Aug 17 09:21:31 user nova-compute[72998]: DEBUG os_brick.utils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ab34e-ff72-4214-aec1-d871089e73d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2506364-6f7d-4400-b6eb-d31f85fa52eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb66a050-78d0-4765-92c8-28170d85d269]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c9c37b-a213-4c51-9cce-3dc0f2be3621]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:21:31 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:21:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[620da0ab-d9d1-45a2-8064-e7fae1e08e56]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG os_brick.utils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:21:31 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating existing volume attachment record: 94f85336-1b54-4940-8aa4-df17ac56149a {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:21:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAnqHImB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:21:41 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:21:41 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:21:41 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6230cf1d-f550-4a40-afcd-9475bff24fb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:21:41 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cf5f4d-21f9-4fa7-a1eb-73a59edaf79e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9] added
Aug 17 09:21:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d65a2e-ca38-4235-8a70-204a2fd43e74]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a39cf5-1d79-46f3-893f-934561768c38]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAnqHImB {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAnqHImB" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39dd509-99b1-454d-a21e-89b95fd43b4e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FAnqHImB'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[477f72a5-3c79-4cb8-9c50-6026ed6ec7b5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea803f-c3d0-4e05-bd90-b731868f7159]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:21:41 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:21:41 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:21:41 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:21:41 user nova-compute[72998]: 
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfee1fb-f14d-49bf-8b53-3670d0a37c4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9, portal: 172.16.0.220,3260]
Aug 17 09:21:41 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9, portal: 172.16.0.220,3260] successful.
Aug 17 09:21:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61abbe5-d79b-48c7-813b-33f9a4ef1052]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff0382-700a-49e8-9563-6199c84bb009]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 (non-flash)
Aug 17 09:21:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 (non-flash)
Aug 17 09:21:41 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8158e030-f6e1-4ce5-a52c-0c85900c1c87]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:41 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:21:42 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:21:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAnqHImB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:21:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:21:42 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23961363166623830', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:21:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961363166623830', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:21:42 user nova-compute[72998]: DEBUG nova.objects.instance [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:21:42 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 09:21:42 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:21:42 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:21:42 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:21:42 user nova-compute[72998]:   <serial>78181fdf-4cd9-4a17-9613-68f582abf5b9</serial>
Aug 17 09:21:42 user nova-compute[72998]: </disk>
Aug 17 09:21:42 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 09:21:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:21:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:21:43 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No VIF found with MAC fa:16:3e:e1:60:c8, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:21:43 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-8b0f6b34-00d4-448a-9c3a-715ac15f00eb tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.965s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:21:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:21:45 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:21:45 user nova-compute[72998]: INFO nova.compute.manager [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Detaching volume 78181fdf-4cd9-4a17-9613-68f582abf5b9
Aug 17 09:21:45 user nova-compute[72998]: INFO nova.virt.block_device [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attempting to driver detach volume 78181fdf-4cd9-4a17-9613-68f582abf5b9 from mountpoint /dev/vdb
Aug 17 09:21:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Attempting to detach device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 09:21:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:21:45 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:21:45 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:21:45 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:21:45 user nova-compute[72998]:   <serial>78181fdf-4cd9-4a17-9613-68f582abf5b9</serial>
Aug 17 09:21:45 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:21:45 user nova-compute[72998]: </disk>
Aug 17 09:21:45 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:21:45 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully detached device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the persistent domain config.
Aug 17 09:21:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 09:21:45 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:21:45 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:21:45 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:21:45 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:21:45 user nova-compute[72998]:   <serial>78181fdf-4cd9-4a17-9613-68f582abf5b9</serial>
Aug 17 09:21:45 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:21:45 user nova-compute[72998]: </disk>
Aug 17 09:21:45 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692264106.2710571, a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 09:21:46 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully detached device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the live domain config.
Aug 17 09:21:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAnqHImB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:21:46 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0e1551-b92f-46cc-ac50-5143f2dc3daf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5c9a7c-235e-479a-8c5f-45de349f1320]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 (non-flash)
Aug 17 09:21:46 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 (non-flash)
Aug 17 09:21:46 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4884c0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b432ad2e-10ee-41d8-884c-299457e677b5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e918bc40-124e-4427-a600-3aa695206854]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[290f82c3-8d3b-488d-9362-59c3c8a9df91]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d519bb12-1c85-48ca-bc18-447ce2dfe170]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b26671-f786-4d23-b108-eb971cab234e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6255d69c-3d9b-4798-9724-c58401b27c32]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9, portal: 172.16.0.220,3260]
Aug 17 09:21:46 user nova-compute[72998]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9, portal: 172.16.0.220,3260] successful.
Aug 17 09:21:46 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78181fdf-4cd9-4a17-9613-68f582abf5b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676f77c-442d-4b30-a9b2-23e76a02b971]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== disconnect_volume: return (247ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:21:46 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:21:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:21:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1d98f765-0096-41e5-aecd-cd110c69796e tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:21:47 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:21:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:21:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:21:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:21:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:21:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:21:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:21:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:21:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:58 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:21:58 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:21:58 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:21:59 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:21:59 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:21:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=24.010208129882812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:21:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:22:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:05 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:05 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:22:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:22:16 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:22:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:22:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:22:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:22:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:22:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:22:40 user nova-compute[72998]: INFO nova.compute.manager [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attaching volume 634bbdd6-7207-49e6-be96-c54fbcae659d to /dev/vdb
Aug 17 09:22:40 user nova-compute[72998]: DEBUG os_brick.utils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1bf960-7679-460f-a4ed-26e8d3db27f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e9388f-404a-4fa8-abe0-8318661b94c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21dff20-3437-47da-97c1-6595e40ea5a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[80945d22-76b7-4d4a-9b70-b78381aaca49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:22:40 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:22:40 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ff3b00-297c-4c67-92af-b2696a0779a7]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG os_brick.utils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:22:40 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating existing volume attachment record: 1e52b988-ba99-4462-a1ed-957cb5d461d9 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:22:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:22:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:47 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:22:47 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:22:47 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:22:47 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:22:47 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:22:48 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:22:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:22:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXizvCaH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:22:50 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:22:50 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:22:50 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd550478-1945-48f9-be6d-a6b26e1b5d50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:22:50 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0560982f-e457-4341-baab-696948267a7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d] added
Aug 17 09:22:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd4589b-d78f-4b80-9b69-6dede2318e73]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5319b525-0d3e-4441-b2f8-8036ded7ca77]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXizvCaH {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXizvCaH" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17c1724-8a3c-4829-bebc-f0883b9a7129]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AXizvCaH'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d44a10-dec3-419e-8e2d-6b1384efc815]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b975f9-21d2-41a3-a12d-35c39f1c8276]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:22:50 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:22:50 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:22:50 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:22:50 user nova-compute[72998]: 
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49ca45b-f050-4eb9-a1ab-8e3c62d67c87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d, portal: 172.16.0.220,3260]
Aug 17 09:22:50 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d, portal: 172.16.0.220,3260] successful.
Aug 17 09:22:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[91881637-bff4-47f8-960f-85ff8e00d92e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea27d2cc-4720-4373-9ba7-1e5d57b89163]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d (non-flash)
Aug 17 09:22:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d (non-flash)
Aug 17 09:22:50 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[40688448-8e24-41df-b732-0dcb838b786f]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:22:50 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXizvCaH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:22:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:22:51 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23166626465343839', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:22:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166626465343839', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:22:51 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:22:51 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 09:22:51 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:22:51 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:22:51 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:22:51 user nova-compute[72998]:   <serial>634bbdd6-7207-49e6-be96-c54fbcae659d</serial>
Aug 17 09:22:51 user nova-compute[72998]: </disk>
Aug 17 09:22:51 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 09:22:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:22:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:22:52 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No VIF found with MAC fa:16:3e:e1:60:c8, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:22:52 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c083230d-2a44-4a6a-ad1f-ee24d8e64e58 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.155s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:22:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:22:54 user nova-compute[72998]: INFO nova.compute.manager [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Detaching volume 634bbdd6-7207-49e6-be96-c54fbcae659d
Aug 17 09:22:54 user nova-compute[72998]: INFO nova.virt.block_device [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attempting to driver detach volume 634bbdd6-7207-49e6-be96-c54fbcae659d from mountpoint /dev/vdb
Aug 17 09:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Attempting to detach device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 09:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:22:54 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:22:54 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:22:54 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:22:54 user nova-compute[72998]:   <serial>634bbdd6-7207-49e6-be96-c54fbcae659d</serial>
Aug 17 09:22:54 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:22:54 user nova-compute[72998]: </disk>
Aug 17 09:22:54 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:22:54 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully detached device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the persistent domain config.
Aug 17 09:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 09:22:54 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:22:54 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:22:54 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:22:54 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:22:54 user nova-compute[72998]:   <serial>634bbdd6-7207-49e6-be96-c54fbcae659d</serial>
Aug 17 09:22:54 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:22:54 user nova-compute[72998]: </disk>
Aug 17 09:22:54 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692264175.0956933, a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 09:22:55 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully detached device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the live domain config.
Aug 17 09:22:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXizvCaH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:22:55 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ce049-0c27-4236-9f46-ca9b1943fbab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb3822-b556-4e84-b3fb-da8a41084fdb]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d (non-flash)
Aug 17 09:22:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d (non-flash)
Aug 17 09:22:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4884d5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4319f4f-9b9c-4a3b-927e-3f6a0b3c5abc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c9600-bfe1-463c-b083-673455c0c593]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[16140640-e031-4478-a2b0-ac7db5618670]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0ef32a-5f3c-4d91-b7c5-58d5a8ecb3a5]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd0116d-747b-48cc-adac-38ea66a5411e]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdd703e-152f-4af9-9a2a-701e4ee4bef9]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d, portal: 172.16.0.220,3260]
Aug 17 09:22:55 user nova-compute[72998]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d, portal: 172.16.0.220,3260] successful.
Aug 17 09:22:55 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bbdd6-7207-49e6-be96-c54fbcae659d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a96930-d0c5-476a-afbb-830e9168d8bb]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== disconnect_volume: return (265ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:22:55 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:22:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:22:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-774393c7-7e00-4617-a6e2-3ccde092ba03 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:22:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:22:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:22:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:22:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:22:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:22:59 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:22:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:23:00 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:23:00 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=24.00925064086914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:23:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:23:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:23:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:23:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:23:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:23:06 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:23:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:23:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:23:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:23:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:23:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:23:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:23:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:23:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:28 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:23:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:23:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:23:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:23:48 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:23:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:23:48 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:23:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:23:48 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:23:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:23:48 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:23:48 user nova-compute[72998]: INFO nova.compute.manager [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attaching volume e1f51515-9a22-4fda-80f6-5c22f3693095 to /dev/vdb
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG os_brick.utils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c546ff8-a4d6-4328-bae2-9f1663065d4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cf2d1c-d821-4c62-989c-13b88a4caca6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[618acd2a-d08a-4759-962e-0edb2aa32ee1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b147d6-39db-49e3-a5f4-fc8efe901f91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:23:49 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e141a4e1-e8ce-45c6-bf32-17b8a7b1dc69]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG os_brick.utils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating existing volume attachment record: 82bf108b-656b-4aec-8349-97c9ab5534e2 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:23:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:23:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYOXsFLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:23:59 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:23:59 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:23:59 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[65df972b-27da-41a9-ba45-c10c98991bbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:23:59 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[07de8115-e677-4efb-81cf-a395ca2fb0ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095] added
Aug 17 09:23:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03b0421-e162-45e6-a9ca-4106eb3a7c21]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df93b7-15cd-4894-91f8-0f30f486b550]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYOXsFLS {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYOXsFLS" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4591b53f-44e7-4db2-b40b-b19592e6382a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYOXsFLS'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea034cd9-b696-41e9-a94e-22d916933c5b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe393a-446e-4247-8374-2cde3f4bacde]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:23:59 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:23:59 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:23:59 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:23:59 user nova-compute[72998]: 
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c8383d-a1f1-4084-a82e-e5a56d5e15ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095, portal: 172.16.0.220,3260]
Aug 17 09:23:59 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095, portal: 172.16.0.220,3260] successful.
Aug 17 09:23:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd08f871-f565-4e8d-adb7-fb0dff39754a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2cc555-b46f-4c09-9371-1be4fe3ce2f9]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 (non-flash)
Aug 17 09:23:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 (non-flash)
Aug 17 09:23:59 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af54b23-02d0-4d6a-a41d-8a74208d6dad]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:23:59 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYOXsFLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:24:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:24:00 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23335336435623833', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:24:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335336435623833', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:24:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:24:00 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 09:24:00 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:24:00 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:24:00 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:24:00 user nova-compute[72998]:   <serial>e1f51515-9a22-4fda-80f6-5c22f3693095</serial>
Aug 17 09:24:00 user nova-compute[72998]: </disk>
Aug 17 09:24:00 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 09:24:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:24:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] No VIF found with MAC fa:16:3e:e1:60:c8, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-c5370f08-bfe1-4c4b-8a6b-2af2ea95be6a tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.246s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:24:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:24:02 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:24:02 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:24:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8801MB free_disk=24.008365631103516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:24:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:24:03 user nova-compute[72998]: INFO nova.compute.manager [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Detaching volume e1f51515-9a22-4fda-80f6-5c22f3693095
Aug 17 09:24:03 user nova-compute[72998]: INFO nova.virt.block_device [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Attempting to driver detach volume e1f51515-9a22-4fda-80f6-5c22f3693095 from mountpoint /dev/vdb
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Attempting to detach device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:24:03 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:24:03 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:24:03 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:24:03 user nova-compute[72998]:   <serial>e1f51515-9a22-4fda-80f6-5c22f3693095</serial>
Aug 17 09:24:03 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:24:03 user nova-compute[72998]: </disk>
Aug 17 09:24:03 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:24:03 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully detached device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the persistent domain config.
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:24:03 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:24:03 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:24:03 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:24:03 user nova-compute[72998]:   <serial>e1f51515-9a22-4fda-80f6-5c22f3693095</serial>
Aug 17 09:24:03 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:24:03 user nova-compute[72998]: </disk>
Aug 17 09:24:03 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692264243.9224477, a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 09:24:03 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully detached device vdb from instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc from the live domain config.
Aug 17 09:24:03 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYOXsFLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:24:03 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:24:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de8a655-61cb-44d4-8f7e-a5df95efade4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[556da03c-e0d3-405f-b6ab-6c9c4a806f09]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 (non-flash)
Aug 17 09:24:03 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 (non-flash)
Aug 17 09:24:03 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa488203520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:24:03 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e811204-0419-43d3-877e-29c0d719faa5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c74fe8-beee-4e0f-aa2f-d25611feb742]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a11db-11ee-453c-a23c-36d80c32c59b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e9ccd0-90c1-426d-ae2e-35a297d2efdf]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c50a55a-db92-4c6e-9cb3-bc29b9fbe9cb]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c6597-df89-472d-b979-93961ee3f31b]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095, portal: 172.16.0.220,3260]
Aug 17 09:24:04 user nova-compute[72998]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095, portal: 172.16.0.220,3260] successful.
Aug 17 09:24:04 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f51515-9a22-4fda-80f6-5c22f3693095 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c24a8e7-132e-493d-a802-65f650dac2c7]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] <== disconnect_volume: return (255ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:24:04 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:24:05 user nova-compute[72998]: DEBUG nova.objects.instance [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'flavor' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:24:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-4b6bc0e6-f8ec-493a-85d6-194f2dd8a4a1 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:24:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:24:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:24:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:24:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:24:08 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:24:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:24:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:24:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:24:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:24:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:24:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:24:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:24:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:24:49 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:24:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:24:49 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:24:49 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:24:49 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:24:49 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:24:50 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [{"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:24:50 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:24:50 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:24:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:24:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:00 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:25:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:25:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:25:01 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:25:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:25:02 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:25:02 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:25:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8819MB free_disk=24.00753402709961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:25:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:25:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:09 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:25:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:25:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:29 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:25:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:25:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:25:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:25:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:25:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:25:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:25:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:25:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:25:38 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:25:38 user nova-compute[72998]: INFO nova.compute.manager [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Terminating instance
Aug 17 09:25:38 user nova-compute[72998]: DEBUG nova.compute.manager [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 09:25:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:38 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-814c25bb-53c9-40eb-be2e-20b1a71df98a req-63f733f5-25a4-44c3-afc6-79e434cf4095 service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received event network-vif-unplugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-814c25bb-53c9-40eb-be2e-20b1a71df98a req-63f733f5-25a4-44c3-afc6-79e434cf4095 service nova] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-814c25bb-53c9-40eb-be2e-20b1a71df98a req-63f733f5-25a4-44c3-afc6-79e434cf4095 service nova] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-814c25bb-53c9-40eb-be2e-20b1a71df98a req-63f733f5-25a4-44c3-afc6-79e434cf4095 service nova] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-814c25bb-53c9-40eb-be2e-20b1a71df98a req-63f733f5-25a4-44c3-afc6-79e434cf4095 service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] No waiting events found dispatching network-vif-unplugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG nova.compute.manager [req-814c25bb-53c9-40eb-be2e-20b1a71df98a req-63f733f5-25a4-44c3-afc6-79e434cf4095 service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received event network-vif-unplugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Instance destroyed successfully.
Aug 17 09:25:39 user nova-compute[72998]: DEBUG nova.objects.instance [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lazy-loading 'resources' on Instance uuid a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2146624845',display_name='tempest-SnapshotDataIntegrityTests-server-2146624845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2146624845',id=52,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmJ0X7xp9ihaCPzV16EZUoqUMyNeKgWnfL12/kxJUrwlJGbbQQOCiikRDaSE3KdW5uUA30VYg0OkgMM1OyZlEzwYJv6TjgmS13QmVGKF/hGTlQCrSPjtmnLRhKyKh/2Nw==',key_name='tempest-keypair-642266717',keypairs=<?>,launch_index=0,launched_at=2023-08-17T09:18:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa011e0392f8475890e8356d3dbbde72',ramdisk_id='',reservation_id='r-575073vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-306227939',owner_user_name='tempest-SnapshotDataIntegrityTests-306227939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T09:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c37152cb2e54db0b14343c3e482b283',uuid=a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Converting VIF {"id": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "address": "fa:16:3e:e1:60:c8", "network": {"id": "220cacf5-12aa-4250-990a-ddbf1f4c9a90", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-905124745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa011e0392f8475890e8356d3dbbde72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2b74f9-ad", "ovs_interfaceid": "8f2b74f9-ad5f-47c7-8fa2-40477e3f0080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:60:c8,bridge_name='br-int',has_traffic_filtering=True,id=8f2b74f9-ad5f-47c7-8fa2-40477e3f0080,network=Network(220cacf5-12aa-4250-990a-ddbf1f4c9a90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2b74f9-ad') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG os_vif [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:60:c8,bridge_name='br-int',has_traffic_filtering=True,id=8f2b74f9-ad5f-47c7-8fa2-40477e3f0080,network=Network(220cacf5-12aa-4250-990a-ddbf1f4c9a90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2b74f9-ad') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f2b74f9-ad, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:25:39 user nova-compute[72998]: INFO os_vif [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:60:c8,bridge_name='br-int',has_traffic_filtering=True,id=8f2b74f9-ad5f-47c7-8fa2-40477e3f0080,network=Network(220cacf5-12aa-4250-990a-ddbf1f4c9a90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2b74f9-ad')
Aug 17 09:25:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Deleting instance files /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc_del
Aug 17 09:25:39 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Deletion of /opt/stack/data/nova/instances/a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc_del complete
Aug 17 09:25:39 user nova-compute[72998]: INFO nova.compute.manager [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 09:25:39 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 09:25:39 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 09:25:40 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:25:40 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Took 0.88 seconds to deallocate network for instance.
Aug 17 09:25:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:25:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:25:40 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:25:40 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:25:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:25:40 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Deleted allocations for instance a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc
Aug 17 09:25:40 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-5a05eb38-c833-4df9-97cc-619efff0ffe4 tempest-SnapshotDataIntegrityTests-306227939 tempest-SnapshotDataIntegrityTests-306227939-project-member] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:25:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-9f7f377e-36b9-4e60-9fa3-63e1414391c5 req-45ef9b87-94af-43f3-b0bf-72c183a4450f service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received event network-vif-plugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:25:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9f7f377e-36b9-4e60-9fa3-63e1414391c5 req-45ef9b87-94af-43f3-b0bf-72c183a4450f service nova] Acquiring lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:25:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9f7f377e-36b9-4e60-9fa3-63e1414391c5 req-45ef9b87-94af-43f3-b0bf-72c183a4450f service nova] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:25:41 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-9f7f377e-36b9-4e60-9fa3-63e1414391c5 req-45ef9b87-94af-43f3-b0bf-72c183a4450f service nova] Lock "a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:25:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-9f7f377e-36b9-4e60-9fa3-63e1414391c5 req-45ef9b87-94af-43f3-b0bf-72c183a4450f service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] No waiting events found dispatching network-vif-plugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:25:41 user nova-compute[72998]: WARNING nova.compute.manager [req-9f7f377e-36b9-4e60-9fa3-63e1414391c5 req-45ef9b87-94af-43f3-b0bf-72c183a4450f service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received unexpected event network-vif-plugged-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 for instance with vm_state deleted and task_state None.
Aug 17 09:25:41 user nova-compute[72998]: DEBUG nova.compute.manager [req-9f7f377e-36b9-4e60-9fa3-63e1414391c5 req-45ef9b87-94af-43f3-b0bf-72c183a4450f service nova] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Received event network-vif-deleted-8f2b74f9-ad5f-47c7-8fa2-40477e3f0080 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:25:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:25:51 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:25:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:25:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:25:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:25:54 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692264339.519529, a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:25:54 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] VM Stopped (Lifecycle Event)
Aug 17 09:25:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-1693606c-760b-4110-ab3d-d0c7cb03ae1c None None] [instance: a3dcc55b-b5e3-4e28-9ef2-3d1273780cdc] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:25:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:25:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:25:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:25:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:25:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:25:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:25:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:26:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:26:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:26:02 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:26:03 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:26:03 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=24.03466033935547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:26:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:26:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:05 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:26:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:26:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:26:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:22 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 09:26:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 09:26:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:26:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:26:29 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:31 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 09:26:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:34 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:39 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:44 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:26:49 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:51 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:26:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:26:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:26:51 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:26:54 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:26:59 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:04 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:27:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:27:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:27:04 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:27:05 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:27:05 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:27:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=24.02303695678711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:27:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:27:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:27:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:27:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:27:05 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:27:05 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:27:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:27:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:27:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:09 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:27:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:14 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:19 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Starting instance... {{(pid=72998) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72998) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 09:27:22 user nova-compute[72998]: INFO nova.compute.claims [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Claim successful on node user
Aug 17 09:27:22 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Start building networks asynchronously for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Allocating IP information in the background. {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 09:27:22 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] allocate_for_instance() {{(pid=72998) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 09:27:22 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 09:27:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Start building block device mappings for instance. {{(pid=72998) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG nova.policy [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10944ec81453416ca259688f851b8233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b051287e18e8413c8d5fd42b22100baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72998) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Start spawning the instance on the hypervisor. {{(pid=72998) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Creating instance directory {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 09:27:23 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Creating image(s)
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "/opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "/opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.217s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "932546811862fb5602071b2d70e9794464153269" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "932546811862fb5602071b2d70e9794464153269" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk 1073741824 {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269,backing_fmt=raw /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk 1073741824" returned: 0 in 0.064s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "932546811862fb5602071b2d70e9794464153269" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269 --force-share --output=json" returned: 0 in 0.182s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk. size=1073741824 {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 09:27:23 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG nova.virt.disk.api [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Cannot resize image /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk to a smaller size. {{(pid=72998) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'migration_context' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Created local disks {{(pid=72998) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Ensure instance console log exists: /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/console.log {{(pid=72998) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Successfully created port: a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 09:27:24 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Successfully updated port: a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Building network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-a43c59bc-54e9-446b-a63a-58e79d05a632 req-1d042f04-0bbc-4a5e-98ab-34c8ddfad787 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-changed-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [req-a43c59bc-54e9-446b-a63a-58e79d05a632 req-1d042f04-0bbc-4a5e-98ab-34c8ddfad787 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Refreshing instance network info cache due to event network-changed-a6d1e595-cf26-44f6-8293-e9b5cd00dad1. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a43c59bc-54e9-446b-a63a-58e79d05a632 req-1d042f04-0bbc-4a5e-98ab-34c8ddfad787 service nova] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Instance cache missing network info. {{(pid=72998) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.neutron [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Instance network_info: |[{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72998) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a43c59bc-54e9-446b-a63a-58e79d05a632 req-1d042f04-0bbc-4a5e-98ab-34c8ddfad787 service nova] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.neutron [req-a43c59bc-54e9-446b-a63a-58e79d05a632 req-1d042f04-0bbc-4a5e-98ab-34c8ddfad787 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Refreshing network info cache for port a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Start _get_guest_xml network_info=[{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_format': None, 'guest_format': None, 'image_id': '2fbaeab0-5441-4c6d-b8e6-2fab61f67348'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 09:27:25 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:27:25 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] CPU controller missing on host. {{(pid=72998) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.host [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] CPU controller found on host. {{(pid=72998) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72998) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T08:10:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T08:10:22Z,direct_url=<?>,disk_format='qcow2',id=2fbaeab0-5441-4c6d-b8e6-2fab61f67348,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bd1b2e952e7746f0b4f07fcf9c92ca08',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T08:10:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Flavor limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Image limits 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Flavor pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Image pref 0:0:0 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Got 1 possible topologies {{(pid=72998) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.hardware [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72998) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:27:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-867095828',display_name='tempest-SnapshotDataIntegrityTests-server-867095828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-867095828',id=53,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrFAYtuKzLrMffTPV4W+HHNgJES5wZdQHft0ctKs3t3BuAEbppoeNvGx/2qbpgF79fAOG9PczrD6TyJFIJAQlU4Zq8rZ3kcloOQqVDYUH4pr6/2s3P4iMKXeqnCXR6EXQ==',key_name='tempest-keypair-1876181949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b051287e18e8413c8d5fd42b22100baa',ramdisk_id='',reservation_id='r-oztrne20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1323463921',owner_user_name='tempest-SnapshotDataIntegrityTests-1323463921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10944ec81453416ca259688f851b8233',uuid=fcac731b-d230-4324-96ce-e670dfc30be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72998) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Converting VIF {"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:5f:48,bridge_name='br-int',has_traffic_filtering=True,id=a6d1e595-cf26-44f6-8293-e9b5cd00dad1,network=Network(ae438bc8-7b90-4389-8c75-7b575cccdf2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d1e595-cf') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'pci_devices' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 09:27:25 user nova-compute[72998]:   <uuid>fcac731b-d230-4324-96ce-e670dfc30be5</uuid>
Aug 17 09:27:25 user nova-compute[72998]:   <name>instance-00000035</name>
Aug 17 09:27:25 user nova-compute[72998]:   <memory>524288</memory>
Aug 17 09:27:25 user nova-compute[72998]:   <vcpu>1</vcpu>
Aug 17 09:27:25 user nova-compute[72998]:   <metadata>
Aug 17 09:27:25 user nova-compute[72998]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 09:27:25 user nova-compute[72998]:       <nova:package version="0.0.0"/>
Aug 17 09:27:25 user nova-compute[72998]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-867095828</nova:name>
Aug 17 09:27:25 user nova-compute[72998]:       <nova:creationTime>2023-08-17 09:27:25</nova:creationTime>
Aug 17 09:27:25 user nova-compute[72998]:       <nova:flavor name="m1.tiny">
Aug 17 09:27:25 user nova-compute[72998]:         <nova:memory>512</nova:memory>
Aug 17 09:27:25 user nova-compute[72998]:         <nova:disk>1</nova:disk>
Aug 17 09:27:25 user nova-compute[72998]:         <nova:swap>0</nova:swap>
Aug 17 09:27:25 user nova-compute[72998]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 09:27:25 user nova-compute[72998]:         <nova:vcpus>1</nova:vcpus>
Aug 17 09:27:25 user nova-compute[72998]:       </nova:flavor>
Aug 17 09:27:25 user nova-compute[72998]:       <nova:owner>
Aug 17 09:27:25 user nova-compute[72998]:         <nova:user uuid="10944ec81453416ca259688f851b8233">tempest-SnapshotDataIntegrityTests-1323463921-project-member</nova:user>
Aug 17 09:27:25 user nova-compute[72998]:         <nova:project uuid="b051287e18e8413c8d5fd42b22100baa">tempest-SnapshotDataIntegrityTests-1323463921</nova:project>
Aug 17 09:27:25 user nova-compute[72998]:       </nova:owner>
Aug 17 09:27:25 user nova-compute[72998]:       <nova:root type="image" uuid="2fbaeab0-5441-4c6d-b8e6-2fab61f67348"/>
Aug 17 09:27:25 user nova-compute[72998]:       <nova:ports>
Aug 17 09:27:25 user nova-compute[72998]:         <nova:port uuid="a6d1e595-cf26-44f6-8293-e9b5cd00dad1">
Aug 17 09:27:25 user nova-compute[72998]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 09:27:25 user nova-compute[72998]:         </nova:port>
Aug 17 09:27:25 user nova-compute[72998]:       </nova:ports>
Aug 17 09:27:25 user nova-compute[72998]:     </nova:instance>
Aug 17 09:27:25 user nova-compute[72998]:   </metadata>
Aug 17 09:27:25 user nova-compute[72998]:   <sysinfo type="smbios">
Aug 17 09:27:25 user nova-compute[72998]:     <system>
Aug 17 09:27:25 user nova-compute[72998]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 09:27:25 user nova-compute[72998]:       <entry name="product">OpenStack Nova</entry>
Aug 17 09:27:25 user nova-compute[72998]:       <entry name="version">0.0.0</entry>
Aug 17 09:27:25 user nova-compute[72998]:       <entry name="serial">fcac731b-d230-4324-96ce-e670dfc30be5</entry>
Aug 17 09:27:25 user nova-compute[72998]:       <entry name="uuid">fcac731b-d230-4324-96ce-e670dfc30be5</entry>
Aug 17 09:27:25 user nova-compute[72998]:       <entry name="family">Virtual Machine</entry>
Aug 17 09:27:25 user nova-compute[72998]:     </system>
Aug 17 09:27:25 user nova-compute[72998]:   </sysinfo>
Aug 17 09:27:25 user nova-compute[72998]:   <os>
Aug 17 09:27:25 user nova-compute[72998]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 09:27:25 user nova-compute[72998]:     <boot dev="hd"/>
Aug 17 09:27:25 user nova-compute[72998]:     <smbios mode="sysinfo"/>
Aug 17 09:27:25 user nova-compute[72998]:   </os>
Aug 17 09:27:25 user nova-compute[72998]:   <features>
Aug 17 09:27:25 user nova-compute[72998]:     <acpi/>
Aug 17 09:27:25 user nova-compute[72998]:     <apic/>
Aug 17 09:27:25 user nova-compute[72998]:     <vmcoreinfo/>
Aug 17 09:27:25 user nova-compute[72998]:   </features>
Aug 17 09:27:25 user nova-compute[72998]:   <clock offset="utc">
Aug 17 09:27:25 user nova-compute[72998]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 09:27:25 user nova-compute[72998]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 09:27:25 user nova-compute[72998]:     <timer name="hpet" present="no"/>
Aug 17 09:27:25 user nova-compute[72998]:   </clock>
Aug 17 09:27:25 user nova-compute[72998]:   <cpu mode="custom" match="exact">
Aug 17 09:27:25 user nova-compute[72998]:     <model>Nehalem</model>
Aug 17 09:27:25 user nova-compute[72998]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 09:27:25 user nova-compute[72998]:   </cpu>
Aug 17 09:27:25 user nova-compute[72998]:   <devices>
Aug 17 09:27:25 user nova-compute[72998]:     <disk type="file" device="disk">
Aug 17 09:27:25 user nova-compute[72998]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 09:27:25 user nova-compute[72998]:       <source file="/opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk"/>
Aug 17 09:27:25 user nova-compute[72998]:       <target dev="vda" bus="virtio"/>
Aug 17 09:27:25 user nova-compute[72998]:     </disk>
Aug 17 09:27:25 user nova-compute[72998]:     <interface type="ethernet">
Aug 17 09:27:25 user nova-compute[72998]:       <mac address="fa:16:3e:7e:5f:48"/>
Aug 17 09:27:25 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:27:25 user nova-compute[72998]:       <mtu size="1442"/>
Aug 17 09:27:25 user nova-compute[72998]:       <target dev="tapa6d1e595-cf"/>
Aug 17 09:27:25 user nova-compute[72998]:     </interface>
Aug 17 09:27:25 user nova-compute[72998]:     <serial type="pty">
Aug 17 09:27:25 user nova-compute[72998]:       <log file="/opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/console.log" append="off"/>
Aug 17 09:27:25 user nova-compute[72998]:     </serial>
Aug 17 09:27:25 user nova-compute[72998]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 09:27:25 user nova-compute[72998]:     <video>
Aug 17 09:27:25 user nova-compute[72998]:       <model type="virtio"/>
Aug 17 09:27:25 user nova-compute[72998]:     </video>
Aug 17 09:27:25 user nova-compute[72998]:     <rng model="virtio">
Aug 17 09:27:25 user nova-compute[72998]:       <backend model="random">/dev/urandom</backend>
Aug 17 09:27:25 user nova-compute[72998]:     </rng>
Aug 17 09:27:25 user nova-compute[72998]:     <controller type="usb" index="0" model="none"/>
Aug 17 09:27:25 user nova-compute[72998]:     <memballoon model="virtio">
Aug 17 09:27:25 user nova-compute[72998]:       <stats period="10"/>
Aug 17 09:27:25 user nova-compute[72998]:     </memballoon>
Aug 17 09:27:25 user nova-compute[72998]:   </devices>
Aug 17 09:27:25 user nova-compute[72998]: </domain>
Aug 17 09:27:25 user nova-compute[72998]:  {{(pid=72998) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:27:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-867095828',display_name='tempest-SnapshotDataIntegrityTests-server-867095828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-867095828',id=53,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrFAYtuKzLrMffTPV4W+HHNgJES5wZdQHft0ctKs3t3BuAEbppoeNvGx/2qbpgF79fAOG9PczrD6TyJFIJAQlU4Zq8rZ3kcloOQqVDYUH4pr6/2s3P4iMKXeqnCXR6EXQ==',key_name='tempest-keypair-1876181949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b051287e18e8413c8d5fd42b22100baa',ramdisk_id='',reservation_id='r-oztrne20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1323463921',owner_user_name='tempest-SnapshotDataIntegrityTests-1323463921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T09:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10944ec81453416ca259688f851b8233',uuid=fcac731b-d230-4324-96ce-e670dfc30be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Converting VIF {"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:5f:48,bridge_name='br-int',has_traffic_filtering=True,id=a6d1e595-cf26-44f6-8293-e9b5cd00dad1,network=Network(ae438bc8-7b90-4389-8c75-7b575cccdf2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d1e595-cf') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG os_vif [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:5f:48,bridge_name='br-int',has_traffic_filtering=True,id=a6d1e595-cf26-44f6-8293-e9b5cd00dad1,network=Network(ae438bc8-7b90-4389-8c75-7b575cccdf2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d1e595-cf') {{(pid=72998) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6d1e595-cf, may_exist=True, interface_attrs={}) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6d1e595-cf, col_values=(('external_ids', {'iface-id': 'a6d1e595-cf26-44f6-8293-e9b5cd00dad1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:5f:48', 'vm-uuid': 'fcac731b-d230-4324-96ce-e670dfc30be5'}),), if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:25 user nova-compute[72998]: INFO os_vif [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:5f:48,bridge_name='br-int',has_traffic_filtering=True,id=a6d1e595-cf26-44f6-8293-e9b5cd00dad1,network=Network(ae438bc8-7b90-4389-8c75-7b575cccdf2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d1e595-cf')
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No VIF found with MAC fa:16:3e:7e:5f:48, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.neutron [req-a43c59bc-54e9-446b-a63a-58e79d05a632 req-1d042f04-0bbc-4a5e-98ab-34c8ddfad787 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated VIF entry in instance network info cache for port a6d1e595-cf26-44f6-8293-e9b5cd00dad1. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:27:25 user nova-compute[72998]: DEBUG nova.network.neutron [req-a43c59bc-54e9-446b-a63a-58e79d05a632 req-1d042f04-0bbc-4a5e-98ab-34c8ddfad787 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:27:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-a43c59bc-54e9-446b-a63a-58e79d05a632 req-1d042f04-0bbc-4a5e-98ab-34c8ddfad787 service nova] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-05ff1099-a520-41b8-9660-100577902c20 req-b8eecebe-396d-46cd-9866-674e053b7520 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-05ff1099-a520-41b8-9660-100577902c20 req-b8eecebe-396d-46cd-9866-674e053b7520 service nova] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-05ff1099-a520-41b8-9660-100577902c20 req-b8eecebe-396d-46cd-9866-674e053b7520 service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-05ff1099-a520-41b8-9660-100577902c20 req-b8eecebe-396d-46cd-9866-674e053b7520 service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG nova.compute.manager [req-05ff1099-a520-41b8-9660-100577902c20 req-b8eecebe-396d-46cd-9866-674e053b7520 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] No waiting events found dispatching network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:27:27 user nova-compute[72998]: WARNING nova.compute.manager [req-05ff1099-a520-41b8-9660-100577902c20 req-b8eecebe-396d-46cd-9866-674e053b7520 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received unexpected event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 for instance with vm_state building and task_state spawning.
Aug 17 09:27:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Instance event wait completed in 0 seconds for  {{(pid=72998) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Guest created on hypervisor {{(pid=72998) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692264449.36441, fcac731b-d230-4324-96ce-e670dfc30be5 => Resumed> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:27:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] VM Resumed (Lifecycle Event)
Aug 17 09:27:29 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Instance spawned successfully.
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Found default for hw_cdrom_bus of ide {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Found default for hw_disk_bus of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Found default for hw_input_bus of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Found default for hw_pointer_model of None {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Found default for hw_video_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Found default for hw_vif_model of virtio {{(pid=72998) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 09:27:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.virt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Emitting event <LifecycleEvent: 1692264449.3680482, fcac731b-d230-4324-96ce-e670dfc30be5 => Started> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:27:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] VM Started (Lifecycle Event)
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72998) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 09:27:29 user nova-compute[72998]: INFO nova.compute.manager [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 09:27:29 user nova-compute[72998]: INFO nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Took 6.34 seconds to spawn the instance on the hypervisor.
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-615b746c-e43f-4ce8-86cd-1da78b7333ed req-9dabfaf7-c8fa-4cfe-9ed8-99b0e33b9c92 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-615b746c-e43f-4ce8-86cd-1da78b7333ed req-9dabfaf7-c8fa-4cfe-9ed8-99b0e33b9c92 service nova] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-615b746c-e43f-4ce8-86cd-1da78b7333ed req-9dabfaf7-c8fa-4cfe-9ed8-99b0e33b9c92 service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-615b746c-e43f-4ce8-86cd-1da78b7333ed req-9dabfaf7-c8fa-4cfe-9ed8-99b0e33b9c92 service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:27:29 user nova-compute[72998]: DEBUG nova.compute.manager [req-615b746c-e43f-4ce8-86cd-1da78b7333ed req-9dabfaf7-c8fa-4cfe-9ed8-99b0e33b9c92 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] No waiting events found dispatching network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:27:29 user nova-compute[72998]: WARNING nova.compute.manager [req-615b746c-e43f-4ce8-86cd-1da78b7333ed req-9dabfaf7-c8fa-4cfe-9ed8-99b0e33b9c92 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received unexpected event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 for instance with vm_state building and task_state spawning.
Aug 17 09:27:29 user nova-compute[72998]: INFO nova.compute.manager [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Took 7.14 seconds to build instance.
Aug 17 09:27:29 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b51fc5b8-9904-4259-8077-2fb45d6afb68 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.293s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:27:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:31 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:53 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:27:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:27:53 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:27:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:27:53 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:27:53 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:27:53 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:27:54 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:27:54 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:27:54 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:27:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:27:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:28:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:28:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:28:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:28:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:28:04 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:28:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:28:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:28:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:28:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:28:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:05 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:28:05 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:28:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8515MB free_disk=23.989032745361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:28:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:28:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:28:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance fcac731b-d230-4324-96ce-e670dfc30be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:28:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:28:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:28:06 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:28:06 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:28:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:28:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:28:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:28:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:28:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:28:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:28:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:28:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:28:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:28:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:55 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:28:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:28:55 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:28:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:28:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:28:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:28:56 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:28:56 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:28:56 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:28:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:28:56 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:29:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:29:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:29:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:29:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:29:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:04 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:29:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:29:04 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:29:04 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:29:04 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:05 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:29:05 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:29:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=23.978900909423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance fcac731b-d230-4324-96ce-e670dfc30be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:29:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:29:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:12 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:29:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-378d5499-cf8e-4674-9535-8cd6117de085 req-85ed2183-cf3c-491c-af1f-356d3bb0103f service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-changed-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:29:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-378d5499-cf8e-4674-9535-8cd6117de085 req-85ed2183-cf3c-491c-af1f-356d3bb0103f service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Refreshing instance network info cache due to event network-changed-a6d1e595-cf26-44f6-8293-e9b5cd00dad1. {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 09:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-378d5499-cf8e-4674-9535-8cd6117de085 req-85ed2183-cf3c-491c-af1f-356d3bb0103f service nova] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:29:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-378d5499-cf8e-4674-9535-8cd6117de085 req-85ed2183-cf3c-491c-af1f-356d3bb0103f service nova] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:29:13 user nova-compute[72998]: DEBUG nova.network.neutron [req-378d5499-cf8e-4674-9535-8cd6117de085 req-85ed2183-cf3c-491c-af1f-356d3bb0103f service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Refreshing network info cache for port a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 09:29:14 user nova-compute[72998]: DEBUG nova.network.neutron [req-378d5499-cf8e-4674-9535-8cd6117de085 req-85ed2183-cf3c-491c-af1f-356d3bb0103f service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated VIF entry in instance network info cache for port a6d1e595-cf26-44f6-8293-e9b5cd00dad1. {{(pid=72998) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 09:29:14 user nova-compute[72998]: DEBUG nova.network.neutron [req-378d5499-cf8e-4674-9535-8cd6117de085 req-85ed2183-cf3c-491c-af1f-356d3bb0103f service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:29:14 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-378d5499-cf8e-4674-9535-8cd6117de085 req-85ed2183-cf3c-491c-af1f-356d3bb0103f service nova] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:29:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:29:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:29:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:29:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:29:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:29:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:29:19 user nova-compute[72998]: INFO nova.compute.manager [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attaching volume ed349d00-9d42-4af4-8145-b12d4e0a4c48 to /dev/vdb
Aug 17 09:29:19 user nova-compute[72998]: DEBUG os_brick.utils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7199b40-5a38-4aac-97cd-0792ab5e354d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1af39e5-191c-436b-b030-dd55bcb3217a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:19 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3144afd6-4966-4426-9348-11422aa23621]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b521d1-701a-45c2-abee-70e774f14dd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:29:20 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:29:20 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5123cb75-3e99-4a19-a310-c54042a85fee]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG os_brick.utils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating existing volume attachment record: d317e432-8471-4f32-a909-3c93de645eab {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:29:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snbJCaPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:29:30 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:29:30 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:29:30 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdfe290-9fbf-4a8b-ab7d-a5e0ca35442d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:29:30 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cbbc80-3a77-4ff2-9097-e66e754d70d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48] added
Aug 17 09:29:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f6feac-79dc-4a07-86d1-5246487f26a8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d7ec61-46c1-4de1-a85b-9f0f67ff946a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snbJCaPI {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snbJCaPI" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[018d76bc-b40f-4dfd-b115-357c068f19ef]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snbJCaPI'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bee006-9f0f-4d85-91be-48aad67ce663]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61b13d3-50a8-4664-b4b2-61ccf159d2ab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:29:30 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:29:30 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:29:30 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:29:30 user nova-compute[72998]: 
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[13220974-879c-4a28-9233-71658531bcf1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48, portal: 172.16.0.220,3260]
Aug 17 09:29:30 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48, portal: 172.16.0.220,3260] successful.
Aug 17 09:29:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e25eb-ad32-46c9-b5c3-5b9ec1e9fdc8]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a617ad1-23e7-41ed-b7cd-39b051c7ff63]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 (non-flash)
Aug 17 09:29:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 (non-flash)
Aug 17 09:29:30 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d148dd7-e31c-4f07-ae7b-73cd7417ac90]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snbJCaPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:29:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:29:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:29:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23161376366373466', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:29:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161376366373466', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:29:31 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:29:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 09:29:31 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:29:31 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:29:31 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:29:31 user nova-compute[72998]:   <serial>ed349d00-9d42-4af4-8145-b12d4e0a4c48</serial>
Aug 17 09:29:31 user nova-compute[72998]: </disk>
Aug 17 09:29:31 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 09:29:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:29:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:29:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No VIF found with MAC fa:16:3e:7e:5f:48, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:29:32 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6f0b6c22-8d72-4927-a7d3-6ed1cb4bf65d tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.249s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:29:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:29:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:29:57 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:29:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:29:57 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:29:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:29:57 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:29:57 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:29:57 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:29:58 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:29:58 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:29:58 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:30:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:30:01 user nova-compute[72998]: INFO nova.compute.manager [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Detaching volume ed349d00-9d42-4af4-8145-b12d4e0a4c48
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Verify base images {{(pid=72998) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Image id 2fbaeab0-5441-4c6d-b8e6-2fab61f67348 yields fingerprint 932546811862fb5602071b2d70e9794464153269 {{(pid=72998) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 09:30:01 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] image 2fbaeab0-5441-4c6d-b8e6-2fab61f67348 at (/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269): checking
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] image 2fbaeab0-5441-4c6d-b8e6-2fab61f67348 at (/opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269): image is in use {{(pid=72998) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72998) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] fcac731b-d230-4324-96ce-e670dfc30be5 is a valid instance name {{(pid=72998) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] fcac731b-d230-4324-96ce-e670dfc30be5 has a disk file {{(pid=72998) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:01 user nova-compute[72998]: INFO nova.virt.block_device [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attempting to driver detach volume ed349d00-9d42-4af4-8145-b12d4e0a4c48 from mountpoint /dev/vdb
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Attempting to detach device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:30:01 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:30:01 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:30:01 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:30:01 user nova-compute[72998]:   <serial>ed349d00-9d42-4af4-8145-b12d4e0a4c48</serial>
Aug 17 09:30:01 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:30:01 user nova-compute[72998]: </disk>
Aug 17 09:30:01 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:30:01 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully detached device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the persistent domain config.
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 09:30:01 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:30:01 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:30:01 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:30:01 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:30:01 user nova-compute[72998]:   <serial>ed349d00-9d42-4af4-8145-b12d4e0a4c48</serial>
Aug 17 09:30:01 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:30:01 user nova-compute[72998]: </disk>
Aug 17 09:30:01 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance fcac731b-d230-4324-96ce-e670dfc30be5 is backed by 932546811862fb5602071b2d70e9794464153269 {{(pid=72998) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 09:30:02 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650
Aug 17 09:30:02 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b
Aug 17 09:30:02 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429
Aug 17 09:30:02 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2
Aug 17 09:30:02 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510
Aug 17 09:30:02 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97
Aug 17 09:30:02 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569
Aug 17 09:30:02 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a
Aug 17 09:30:02 user nova-compute[72998]: WARNING nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Active base files: /opt/stack/data/nova/instances/_base/932546811862fb5602071b2d70e9794464153269
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Removable base files: /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650 /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429 /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2 /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510 /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97 /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569 /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c17245cf84ad5234b1817c51baa07a7f241bf650
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2284aee919501053959fbe440ff4b8c7ae11eb6b
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/688433afa192822b2f15a11a34097485dc6c7429
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/839b860bda49e965de223da4b96ee91b344727c2
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca123f115e0da2f088db7549e6ae3efa47427510
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/742b665f389b49fab1719cbcc6f3df1004d9fd97
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3e868dd7147c73b94073c8aa19fb938f80697569
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e580a7a694e1cfba70f35c9788d1358f07803c7a
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4417d2aafdb3fcb185517f4425d44c563602af4c
Aug 17 09:30:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Verification complete {{(pid=72998) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Verify swap images {{(pid=72998) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.imagecache [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Verify ephemeral images {{(pid=72998) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692264602.3812656, fcac731b-d230-4324-96ce-e670dfc30be5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 09:30:02 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully detached device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the live domain config.
Aug 17 09:30:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snbJCaPI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:30:02 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a189f29-e173-42ab-aeb4-b28e9894e7e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c2ee9b-820e-4e5d-af84-8c79eb0fa6ee]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 (non-flash)
Aug 17 09:30:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 (non-flash)
Aug 17 09:30:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4884c3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1debe16-e638-4a7a-99ae-acefff56c5f6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[990994c5-9005-4493-8474-162ad16f1197]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4579e3-3c7f-46ba-83c7-ef948eac5ddf]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc05c3e-9728-4603-b74e-ab8c908bc440]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f023a2db-ee67-4960-8bd5-49d53b0c388d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee73a2-fc73-4a05-be70-e21876058497]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48, portal: 172.16.0.220,3260]
Aug 17 09:30:02 user nova-compute[72998]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48, portal: 172.16.0.220,3260] successful.
Aug 17 09:30:02 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed349d00-9d42-4af4-8145-b12d4e0a4c48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[492122b5-c9a4-4dca-a797-e152be1cbfc0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== disconnect_volume: return (286ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:30:02 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:30:03 user nova-compute[72998]: DEBUG nova.objects.instance [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:30:03 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-b8d12ad5-ac95-4cf6-b9c8-8cd3716f3d8e tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.927s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:30:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:30:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:06 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:30:06 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:30:06 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=23.97728729248047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:30:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance fcac731b-d230-4324-96ce-e670dfc30be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:13 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:30:14 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:30:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:30:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:30:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:30:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:30:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:45 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:30:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:50 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG nova.objects.instance [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:30:55 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:30:56 user nova-compute[72998]: INFO nova.compute.manager [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attaching volume 4de7e1f9-aa05-40ba-8f78-b0d680bfa9de to /dev/vdb
Aug 17 09:30:56 user nova-compute[72998]: DEBUG os_brick.utils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c8241-880c-4223-8550-05132938f4cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c054aa2-3e41-4278-a275-34871e471352]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[317d932e-713b-4312-9169-351e02d5c4b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf4acc2-5bb6-4557-a7f2-48cdc69d3836]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:30:56 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:30:56 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d97d65-5f8d-42c2-92c4-23915507e6a1]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG os_brick.utils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:30:56 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating existing volume attachment record: b46198b8-6c5c-4bea-baac-a5e9fb607cd5 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:30:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:30:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:30:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:30:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:30:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:30:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:30:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:30:59 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:31:00 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:31:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:31:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:31:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:31:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFNLQIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:31:06 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:31:06 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:31:06 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dff551-eadb-4d85-ab1d-ec5689b91921]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:31:06 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1673cfa9-542c-4555-841a-db851b46d663]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de] added
Aug 17 09:31:06 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bd0aa6-8ef8-4a04-bb34-487a7d1f52ef]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[34763ce2-f728-4d12-9c1e-5aa6fa254e6a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlFNLQIY {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlFNLQIY" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[46187105-d5c2-4822-81ec-12e58d2ae024]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlFNLQIY'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6416eb3-7f93-47e4-bd95-f94b866a10cd]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e0ab4e-c99e-46f2-8ee8-7ce340fcdc62]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:31:06 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:31:06 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:31:06 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:31:06 user nova-compute[72998]: 
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de0f86c-7ddf-4acc-a7b2-9a6c6229a7f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de, portal: 172.16.0.220,3260]
Aug 17 09:31:06 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de, portal: 172.16.0.220,3260] successful.
Aug 17 09:31:06 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4f1c4a-83a8-47ef-9c48-355e25113d82]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50a42c1-e57e-4d08-9886-781cca15b1c7]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de (non-flash)
Aug 17 09:31:06 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de (non-flash)
Aug 17 09:31:06 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b9cb6b-6c41-4304-a3ca-4ee64dbe32e8]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:31:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFNLQIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26536343031323330', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536343031323330', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG nova.objects.instance [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 09:31:07 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:31:07 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:31:07 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:31:07 user nova-compute[72998]:   <serial>4de7e1f9-aa05-40ba-8f78-b0d680bfa9de</serial>
Aug 17 09:31:07 user nova-compute[72998]: </disk>
Aug 17 09:31:07 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:31:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No VIF found with MAC fa:16:3e:7e:5f:48, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-dac79eed-682f-4c99-9119-63858f74778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.204s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72998) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 09:31:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:31:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=23.976482391357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance fcac731b-d230-4324-96ce-e670dfc30be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 09:31:08 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 09:31:09 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 09:31:09 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:31:09 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:31:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:31:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:31:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:31:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:31:10 user nova-compute[72998]: INFO nova.compute.manager [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Detaching volume 4de7e1f9-aa05-40ba-8f78-b0d680bfa9de
Aug 17 09:31:10 user nova-compute[72998]: INFO nova.virt.block_device [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attempting to driver detach volume 4de7e1f9-aa05-40ba-8f78-b0d680bfa9de from mountpoint /dev/vdb
Aug 17 09:31:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Attempting to detach device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 09:31:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:31:10 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:31:10 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:31:10 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:31:10 user nova-compute[72998]:   <serial>4de7e1f9-aa05-40ba-8f78-b0d680bfa9de</serial>
Aug 17 09:31:10 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:31:10 user nova-compute[72998]: </disk>
Aug 17 09:31:10 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:31:10 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully detached device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the persistent domain config.
Aug 17 09:31:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 09:31:10 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:31:10 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:31:10 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:31:10 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:31:10 user nova-compute[72998]:   <serial>4de7e1f9-aa05-40ba-8f78-b0d680bfa9de</serial>
Aug 17 09:31:10 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:31:10 user nova-compute[72998]: </disk>
Aug 17 09:31:10 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:31:10 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692264671.2155032, fcac731b-d230-4324-96ce-e670dfc30be5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 09:31:11 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully detached device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the live domain config.
Aug 17 09:31:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlFNLQIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:31:11 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf28b565-8dfc-478d-bb0a-3a3c86641991]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[553b2077-2377-49ac-8462-e0fbd5e7089a]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de (non-flash)
Aug 17 09:31:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de (non-flash)
Aug 17 09:31:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464a75ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dd390d-7a81-43d1-9d4f-7ada5f10c65a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaedd9e-9cb9-40c4-a9dd-6cb5001e9768]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eed664-a237-434f-a471-75589d572eb4]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3031fc-ed2f-4129-ac73-c6f6d87c50d1]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c2bb55-f50b-4328-b32a-592284f13a96]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1598c7bd-5a52-435e-af17-506720369960]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de, portal: 172.16.0.220,3260]
Aug 17 09:31:11 user nova-compute[72998]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de, portal: 172.16.0.220,3260] successful.
Aug 17 09:31:11 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4de7e1f9-aa05-40ba-8f78-b0d680bfa9de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f616455-da8c-470a-8da1-ed0874da7b7a]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== disconnect_volume: return (259ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:31:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:12 user nova-compute[72998]: DEBUG nova.objects.instance [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:31:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-6a319b2e-c0fc-4020-af25-789439981c58 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.824s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:31:12 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:31:15 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:31:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:20 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:31:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:25 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:31:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:30 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:35 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:35 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 09:31:36 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] There are 0 instances to clean {{(pid=72998) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 09:31:37 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:37 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72998) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 09:31:40 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:31:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:42 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:31:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:31:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:31:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:31:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:31:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:31:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:31:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:31:59 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:32:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:32:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:32:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:32:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:32:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:32:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:32:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:32:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:32:05 user nova-compute[72998]: DEBUG nova.objects.instance [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:32:05 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:32:06 user nova-compute[72998]: INFO nova.compute.manager [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attaching volume ea6ee158-fdf2-48a5-be81-dd5160882ac4 to /dev/vdb
Aug 17 09:32:06 user nova-compute[72998]: DEBUG os_brick.utils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[97048d70-c95c-4dc7-b603-9947237dc7db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f86ba9-2128-4d91-a293-c0c5c02b73a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e0ad18-7c26-42f1-9bf5-e0865c6fa620]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[08048371-2e0c-4a0e-a9b3-8981007ecb8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:32:06 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:32:06 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a178d46-e4b0-45b6-a2b8-53191bd407f0]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG os_brick.utils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:32:06 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating existing volume attachment record: d7ba6ce5-b095-40ef-8a62-866264be5211 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:32:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:32:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:32:07 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:32:07 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:32:07 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:32:08 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:32:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=23.975574493408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance fcac731b-d230-4324-96ce-e670dfc30be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:32:08 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:32:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:15 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:32:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdvngKsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:32:22 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:32:22 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:32:22 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf55506-c3ac-4a83-a4de-78533168e740]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:32:22 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cd95b5-57b8-4a35-9353-342ab6b54847]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4] added
Aug 17 09:32:22 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c97d76-40a1-4bcf-920d-bf4a4a07d752]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfe14fc-e988-4bac-b82d-28098f99c864]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdvngKsf {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdvngKsf" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e94cc0-ee68-47a1-a460-80693e6fea54]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdvngKsf'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e74c2e-f6e1-4711-8fd7-a2767713fb86]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2cab31-cf8f-4b78-a742-d1b294a6ae24]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:32:22 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:32:22 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:32:22 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:32:22 user nova-compute[72998]: 
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aed4123-3c8e-4994-9f31-6213a3720b66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4, portal: 172.16.0.220,3260]
Aug 17 09:32:22 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4, portal: 172.16.0.220,3260] successful.
Aug 17 09:32:22 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[796bf78d-4f78-4ace-98bb-e214cfe58566]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bfde89-0971-4fcd-9337-adce4ab80cbf]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 (non-flash)
Aug 17 09:32:22 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 (non-flash)
Aug 17 09:32:22 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df3de6-98bd-4112-b21a-a5343eab0998]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:22 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:32:23 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:32:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdvngKsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:32:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:32:23 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26430353132326335', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:32:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430353132326335', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:32:23 user nova-compute[72998]: DEBUG nova.objects.instance [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:32:23 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 09:32:23 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:32:23 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:32:23 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:32:23 user nova-compute[72998]:   <serial>ea6ee158-fdf2-48a5-be81-dd5160882ac4</serial>
Aug 17 09:32:23 user nova-compute[72998]: </disk>
Aug 17 09:32:23 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 09:32:24 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:24 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Triggering sync for uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 09:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:32:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:32:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:32:24 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No VIF found with MAC fa:16:3e:7e:5f:48, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-ba565443-019b-4a17-afc8-f06f54bf96ed tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.298s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.138s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:32:24 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:32:26 user nova-compute[72998]: INFO nova.compute.manager [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Detaching volume ea6ee158-fdf2-48a5-be81-dd5160882ac4
Aug 17 09:32:26 user nova-compute[72998]: INFO nova.virt.block_device [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attempting to driver detach volume ea6ee158-fdf2-48a5-be81-dd5160882ac4 from mountpoint /dev/vdb
Aug 17 09:32:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Attempting to detach device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:32:26 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:32:26 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:32:26 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:32:26 user nova-compute[72998]:   <serial>ea6ee158-fdf2-48a5-be81-dd5160882ac4</serial>
Aug 17 09:32:26 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:32:26 user nova-compute[72998]: </disk>
Aug 17 09:32:26 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:32:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully detached device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the persistent domain config.
Aug 17 09:32:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:32:26 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:32:26 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:32:26 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:32:26 user nova-compute[72998]:   <serial>ea6ee158-fdf2-48a5-be81-dd5160882ac4</serial>
Aug 17 09:32:26 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:32:26 user nova-compute[72998]: </disk>
Aug 17 09:32:26 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692264746.6299782, fcac731b-d230-4324-96ce-e670dfc30be5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 09:32:26 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully detached device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the live domain config.
Aug 17 09:32:26 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdvngKsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:32:26 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acc7328-1a16-4db7-a222-74dc85c3ad68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[6862aaf9-a39f-41c4-8630-6a1b5b410992]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 (non-flash)
Aug 17 09:32:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 (non-flash)
Aug 17 09:32:26 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa464e5e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[faffcc09-67ee-45d9-8b50-0c2a25be3664]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[710daeb6-86cf-4678-8b6d-ee6fe483afd0]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a04e265-24a1-4017-9dc2-666a59c316b3]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b8d89-9a1c-4f16-a12a-488a76d575d3]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.141s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef47f815-d57d-4ed3-9f63-2feb8a47e63d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:26 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[70158578-94f5-4c55-945e-b6f782827adf]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4, portal: 172.16.0.220,3260]
Aug 17 09:32:27 user nova-compute[72998]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4, portal: 172.16.0.220,3260] successful.
Aug 17 09:32:27 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea6ee158-fdf2-48a5-be81-dd5160882ac4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51ac2a-7822-48c2-a8de-e962f7056d77]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== disconnect_volume: return (404ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG nova.objects.instance [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:32:27 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-da3c3a57-19df-438e-bb80-85d8311726c2 tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.725s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:32:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:32:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:32:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:32:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:32:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:32:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:32:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:32:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:32:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:32:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:32:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:32:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:32:59 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:32:59 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:32:59 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:33:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:33:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:33:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:33:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:33:09 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:33:09 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:33:09 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:10 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:33:10 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:33:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=23.9747314453125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance fcac731b-d230-4324-96ce-e670dfc30be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:33:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:33:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:33:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:16 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:33:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:33:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:33:20 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:33:20 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:33:21 user nova-compute[72998]: INFO nova.compute.manager [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attaching volume 6b74fb18-8e5f-491b-a34c-d8b970f8fbde to /dev/vdb
Aug 17 09:33:21 user nova-compute[72998]: DEBUG os_brick.utils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[7913354c-6b9d-4bda-bb18-8ddaebb6e2cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:18250bf2ddc\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[66607aae-37d7-4f40-bd6e-6971dfd74686]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[08549bd8-f758-4538-a09a-b706c2657807]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d2a957-0616-4d91-9f0b-eac5743c8fa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Running cmd (subprocess): nvme version {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] 'nvme version' failed. Not Retrying. {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] nvme not present on system {{(pid=72998) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 09:33:21 user nova-compute[72998]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 09:33:21 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[523095a9-7a84-4766-9ad7-fbfdec8057f3]: (4, '') {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72998) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] LIGHTOS: no hostnqn found. {{(pid=72998) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG os_brick.utils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:18250bf2ddc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:33:21 user nova-compute[72998]: DEBUG nova.virt.block_device [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating existing volume attachment record: c57d05a9-f075-41d5-ab64-dbec1f320212 {{(pid=72998) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 09:33:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Calling os-brick to attach iSCSI Volume {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfACZqmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:33:31 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:33:31 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:33:31 user nova-compute[72998]: INFO os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cc7e19-6d1f-4351-b28c-e31942b8d3b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 09:33:31 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --interface default --op new {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c098cb-9706-4963-bde5-478963543f5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde] added\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde] added
Aug 17 09:33:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc6deb7-9272-4b60-aca9-ac903435405d]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fb8d4e-3c25-4cdf-9424-96f52e3e9981]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfACZqmz {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfACZqmz" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff21749-95e2-419a-b583-9fd49273709b]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfACZqmz'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5241fadb-a973-4384-8884-fdaac98e56f5]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec5c1f9-c38e-4880-91ad-61d627a03ad5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:33:31 user nova-compute[72998]:  {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 09:33:31 user nova-compute[72998]:  {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:33:31 user nova-compute[72998]: WARNING os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 09:33:31 user nova-compute[72998]: 
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --login {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae2c939-2383-40e9-90af-a55e73f026cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde, portal: 172.16.0.220,3260]
Aug 17 09:33:31 user nova-compute[72998]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde, portal: 172.16.0.220,3260] successful.
Aug 17 09:33:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce78519-306a-4070-bd82-108e8972404c]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4f90cb-9325-4b10-863e-a3ce3df6c76c]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde (non-flash)
Aug 17 09:33:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde (non-flash)
Aug 17 09:33:31 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Connected to 172.16.0.220:3260 {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72998) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72998) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f626a029-4376-4923-9612-0a14dcfa7fd7]: (4, ('- - 0', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:31 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:33:32 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72998) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 09:33:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfACZqmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72998) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 09:33:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:33:32 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23032616339646239', 'path': '/dev/sdb'} {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:33:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032616339646239', 'path': '/dev/sdb'} {{(pid=72998) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 09:33:32 user nova-compute[72998]: DEBUG nova.objects.instance [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:33:32 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 09:33:32 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:33:32 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:33:32 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:33:32 user nova-compute[72998]:   <serial>6b74fb18-8e5f-491b-a34c-d8b970f8fbde</serial>
Aug 17 09:33:32 user nova-compute[72998]: </disk>
Aug 17 09:33:32 user nova-compute[72998]:  {{(pid=72998) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 09:33:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No BDM found with device name vda, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:33:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72998) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 09:33:33 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] No VIF found with MAC fa:16:3e:7e:5f:48, not building metadata {{(pid=72998) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 09:33:33 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-1ff256f1-f6ae-43c1-9125-ff72fd3c682f tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.104s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:33:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:33:35 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:33:35 user nova-compute[72998]: INFO nova.compute.manager [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Detaching volume 6b74fb18-8e5f-491b-a34c-d8b970f8fbde
Aug 17 09:33:35 user nova-compute[72998]: INFO nova.virt.block_device [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Attempting to driver detach volume 6b74fb18-8e5f-491b-a34c-d8b970f8fbde from mountpoint /dev/vdb
Aug 17 09:33:35 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Attempting to detach device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the persistent domain config. {{(pid=72998) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:33:36 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:33:36 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:33:36 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:33:36 user nova-compute[72998]:   <serial>6b74fb18-8e5f-491b-a34c-d8b970f8fbde</serial>
Aug 17 09:33:36 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:33:36 user nova-compute[72998]: </disk>
Aug 17 09:33:36 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:33:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully detached device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the persistent domain config.
Aug 17 09:33:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the live domain config. {{(pid=72998) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.guest [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 09:33:36 user nova-compute[72998]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 09:33:36 user nova-compute[72998]:   <source dev="/dev/sdb"/>
Aug 17 09:33:36 user nova-compute[72998]:   <target dev="vdb" bus="virtio"/>
Aug 17 09:33:36 user nova-compute[72998]:   <serial>6b74fb18-8e5f-491b-a34c-d8b970f8fbde</serial>
Aug 17 09:33:36 user nova-compute[72998]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 09:33:36 user nova-compute[72998]: </disk>
Aug 17 09:33:36 user nova-compute[72998]:  {{(pid=72998) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-efc62961-21a1-49fa-99e6-5c5d3c185354 None None] Received event <DeviceRemovedEvent: 1692264816.4597383, fcac731b-d230-4324-96ce-e670dfc30be5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72998) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.driver [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 09:33:36 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully detached device vdb from instance fcac731b-d230-4324-96ce-e670dfc30be5 from the live domain config.
Aug 17 09:33:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] calling os-brick to detach iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa488263e50>, {'target_iqns': ['iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfACZqmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 09:33:36 user nova-compute[72998]: WARNING os_brick.initiator.connectors.base [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde', 0)] {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68c31fc-ef45-4095-8a9e-ceae5ce72218]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb903036-cf4a-4793-8f1e-82611b15249f]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde (non-flash)\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde (non-flash)
Aug 17 09:33:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde (non-flash)
Aug 17 09:33:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4883e68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde'): ({'sdb'}, set())}) {{(pid=72998) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Removing single pathed devices sdb {{(pid=72998) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eabb2a-b5d4-4fe4-a4cc-f95945193249]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbf34ca-338a-43e6-89c6-f8f1fa4a6944]: (4, ('ok\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Flushing IO for device /dev/sdb {{(pid=72998) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[58507fd1-1646-4ee0-8503-627a243aedaa]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72998) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[397fb794-1ee1-4f68-aaa5-866250b3237d]: (4, ('1', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.linuxscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] SCSI volumes sdb have been removed. {{(pid=72998) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde')] {{(pid=72998) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[198dd0ab-11a5-4752-a603-7dbd2edc9cf0]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --logout {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[1086f9c4-ff3a-4dbc-8b77-e8b6fe95acd9]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde, portal: 172.16.0.220,3260]
Aug 17 09:33:36 user nova-compute[72998]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde, portal: 172.16.0.220,3260] successful.
Aug 17 09:33:36 user nova-compute[72998]:  stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op delete {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b74fb18-8e5f-491b-a34c-d8b970f8fbde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84658) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d240fd-c05f-44b3-b20a-e88465af5699]: (4, ('', '')) {{(pid=84658) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72998) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.base [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] <== disconnect_volume: return (274ms) None {{(pid=72998) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Disconnected iSCSI Volume {{(pid=72998) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 09:33:36 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:37 user nova-compute[72998]: DEBUG nova.objects.instance [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'flavor' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:33:37 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-f9abaf50-24e5-489a-a5fb-0a602ef8778a tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:33:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:33:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:33:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:33:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:33:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:33:59 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:33:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:33:59 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:34:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:34:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:34:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:34:00 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:34:00 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:34:00 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:34:00 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:34:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:34:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:34:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:34:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:34:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:34:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:34:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:34:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:34:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:34:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:34:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:34:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:34:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:34:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:34:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:34:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:34:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:34:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:34:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:34:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=23.97370147705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:34:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:34:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:34:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance fcac731b-d230-4324-96ce-e670dfc30be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:34:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:34:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:34:12 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:34:12 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:34:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:34:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:34:14 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:34:16 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:34:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:34:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:34:17 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:34:21 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:26 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:34:31 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:36 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:41 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:46 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:51 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:34:56 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:01 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:01 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:35:01 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:35:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 09:35:01 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquired lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 09:35:01 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Forcefully refreshing network info cache for instance {{(pid=72998) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 09:35:01 user nova-compute[72998]: DEBUG nova.objects.instance [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lazy-loading 'info_cache' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:35:02 user nova-compute[72998]: DEBUG nova.network.neutron [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [{"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:35:02 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Releasing lock "refresh_cache-fcac731b-d230-4324-96ce-e670dfc30be5" {{(pid=72998) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 09:35:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updated the network info_cache for instance {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 09:35:06 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:08 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:09 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:10 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:10 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:10 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:35:10 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:11 user nova-compute[72998]: INFO nova.compute.manager [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Terminating instance
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.compute.manager [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Start destroying the instance on the hypervisor. {{(pid=72998) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.processutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-2f46c977-20fe-49cf-bd41-79f1bbaaf347 req-085e0988-7d13-4867-bace-919b21c19d79 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-unplugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2f46c977-20fe-49cf-bd41-79f1bbaaf347 req-085e0988-7d13-4867-bace-919b21c19d79 service nova] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2f46c977-20fe-49cf-bd41-79f1bbaaf347 req-085e0988-7d13-4867-bace-919b21c19d79 service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-2f46c977-20fe-49cf-bd41-79f1bbaaf347 req-085e0988-7d13-4867-bace-919b21c19d79 service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-2f46c977-20fe-49cf-bd41-79f1bbaaf347 req-085e0988-7d13-4867-bace-919b21c19d79 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] No waiting events found dispatching network-vif-unplugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.compute.manager [req-2f46c977-20fe-49cf-bd41-79f1bbaaf347 req-085e0988-7d13-4867-bace-919b21c19d79 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-unplugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 for instance with task_state deleting. {{(pid=72998) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 09:35:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:35:11 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=23.972694396972656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Instance fcac731b-d230-4324-96ce-e670dfc30be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72998) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:35:11 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:11 user nova-compute[72998]: INFO nova.virt.libvirt.driver [-] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Instance destroyed successfully.
Aug 17 09:35:12 user nova-compute[72998]: DEBUG nova.objects.instance [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lazy-loading 'resources' on Instance uuid fcac731b-d230-4324-96ce-e670dfc30be5 {{(pid=72998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG nova.virt.libvirt.vif [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T09:27:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-867095828',display_name='tempest-SnapshotDataIntegrityTests-server-867095828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-867095828',id=53,image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrFAYtuKzLrMffTPV4W+HHNgJES5wZdQHft0ctKs3t3BuAEbppoeNvGx/2qbpgF79fAOG9PczrD6TyJFIJAQlU4Zq8rZ3kcloOQqVDYUH4pr6/2s3P4iMKXeqnCXR6EXQ==',key_name='tempest-keypair-1876181949',keypairs=<?>,launch_index=0,launched_at=2023-08-17T09:27:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b051287e18e8413c8d5fd42b22100baa',ramdisk_id='',reservation_id='r-oztrne20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2fbaeab0-5441-4c6d-b8e6-2fab61f67348',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1323463921',owner_user_name='tempest-SnapshotDataIntegrityTests-1323463921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T09:27:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10944ec81453416ca259688f851b8233',uuid=fcac731b-d230-4324-96ce-e670dfc30be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Converting VIF {"id": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "address": "fa:16:3e:7e:5f:48", "network": {"id": "ae438bc8-7b90-4389-8c75-7b575cccdf2c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-432406401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b051287e18e8413c8d5fd42b22100baa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d1e595-cf", "ovs_interfaceid": "a6d1e595-cf26-44f6-8293-e9b5cd00dad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG nova.network.os_vif_util [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:5f:48,bridge_name='br-int',has_traffic_filtering=True,id=a6d1e595-cf26-44f6-8293-e9b5cd00dad1,network=Network(ae438bc8-7b90-4389-8c75-7b575cccdf2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d1e595-cf') {{(pid=72998) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG os_vif [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:5f:48,bridge_name='br-int',has_traffic_filtering=True,id=a6d1e595-cf26-44f6-8293-e9b5cd00dad1,network=Network(ae438bc8-7b90-4389-8c75-7b575cccdf2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d1e595-cf') {{(pid=72998) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6d1e595-cf, bridge=br-int, if_exists=True) {{(pid=72998) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:12 user nova-compute[72998]: INFO os_vif [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:5f:48,bridge_name='br-int',has_traffic_filtering=True,id=a6d1e595-cf26-44f6-8293-e9b5cd00dad1,network=Network(ae438bc8-7b90-4389-8c75-7b575cccdf2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d1e595-cf')
Aug 17 09:35:12 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Deleting instance files /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5_del
Aug 17 09:35:12 user nova-compute[72998]: INFO nova.virt.libvirt.driver [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Deletion of /opt/stack/data/nova/instances/fcac731b-d230-4324-96ce-e670dfc30be5_del complete
Aug 17 09:35:12 user nova-compute[72998]: INFO nova.compute.manager [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 17 09:35:12 user nova-compute[72998]: DEBUG oslo.service.loopingcall [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72998) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG nova.compute.manager [-] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Deallocating network for instance {{(pid=72998) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] deallocate_for_instance() {{(pid=72998) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.network.neutron [-] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Updating instance_info_cache with network_info: [] {{(pid=72998) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 09:35:13 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Took 1.03 seconds to deallocate network for instance.
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-8115205c-a2c1-42b2-b24f-84f7033386a1 req-62670ebe-d4fb-4401-9747-e0e20cc30757 service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-deleted-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:13 user nova-compute[72998]: INFO nova.scheduler.client.report [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Deleted allocations for instance fcac731b-d230-4324-96ce-e670dfc30be5
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-e50e0ccf-f4d6-446f-9df9-65fe69f2917c tempest-SnapshotDataIntegrityTests-1323463921 tempest-SnapshotDataIntegrityTests-1323463921-project-member] Lock "fcac731b-d230-4324-96ce-e670dfc30be5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.340s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] No waiting events found dispatching network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:35:13 user nova-compute[72998]: WARNING nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received unexpected event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 for instance with vm_state deleted and task_state None.
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] No waiting events found dispatching network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:35:13 user nova-compute[72998]: WARNING nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received unexpected event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 for instance with vm_state deleted and task_state None.
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] No waiting events found dispatching network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:35:13 user nova-compute[72998]: WARNING nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received unexpected event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 for instance with vm_state deleted and task_state None.
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-unplugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] No waiting events found dispatching network-vif-unplugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:35:13 user nova-compute[72998]: WARNING nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received unexpected event network-vif-unplugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 for instance with vm_state deleted and task_state None.
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Acquiring lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] Lock "fcac731b-d230-4324-96ce-e670dfc30be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:35:13 user nova-compute[72998]: DEBUG nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] No waiting events found dispatching network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 {{(pid=72998) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 09:35:13 user nova-compute[72998]: WARNING nova.compute.manager [req-b03209b1-acfa-4567-9a0f-9eb71052fef7 req-a3113668-20f8-44cf-ba85-d83674cff5af service nova] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Received unexpected event network-vif-plugged-a6d1e595-cf26-44f6-8293-e9b5cd00dad1 for instance with vm_state deleted and task_state None.
Aug 17 09:35:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:16 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:19 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:19 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:35:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:26 user nova-compute[72998]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692264911.9773285, fcac731b-d230-4324-96ce-e670dfc30be5 => Stopped> {{(pid=72998) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 09:35:26 user nova-compute[72998]: INFO nova.compute.manager [-] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] VM Stopped (Lifecycle Event)
Aug 17 09:35:26 user nova-compute[72998]: DEBUG nova.compute.manager [None req-d4b307db-6b37-4095-bce6-5d55cd2f6bf3 None None] [instance: fcac731b-d230-4324-96ce-e670dfc30be5] Checking state {{(pid=72998) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 09:35:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:35:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:35:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:35:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:35:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:35:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:35:32 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:37 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:41 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:35:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:35:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:35:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:35:42 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:47 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:52 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:35:57 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:36:02 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:36:02 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:36:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Starting heal instance info cache {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 09:36:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Rebuilding the list of instances to heal {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 09:36:02 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Didn't find any instances for network info cache update. {{(pid=72998) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 09:36:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:36:05 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:36:07 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:36:07 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:36:08 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:36:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:36:11 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:36:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:36:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:36:11 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:36:11 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Auditing locally available compute resources for user (node: user) {{(pid=72998) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:36:12 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:36:12 user nova-compute[72998]: WARNING nova.virt.libvirt.driver [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Hypervisor/Node resource view: name=user free_ram=9073MB free_disk=23.99936294555664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=72998) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72998) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing inventories for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating ProviderTree inventory for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Updating inventory in ProviderTree for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing aggregate associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, aggregates: None {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Refreshing trait associations for resource provider fab9829a-6c05-4a2c-bb1e-0919bb928c91, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=72998) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.compute.provider_tree [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed in ProviderTree for provider: fab9829a-6c05-4a2c-bb1e-0919bb928c91 {{(pid=72998) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.scheduler.client.report [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Inventory has not changed for provider fab9829a-6c05-4a2c-bb1e-0919bb928c91 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72998) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG nova.compute.resource_tracker [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Compute_service record updated for user:user {{(pid=72998) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 09:36:12 user nova-compute[72998]: DEBUG oslo_concurrency.lockutils [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=72998) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 09:36:13 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:36:15 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:36:17 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:36:17 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:36:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:36:21 user nova-compute[72998]: DEBUG oslo_service.periodic_task [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72998) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 09:36:21 user nova-compute[72998]: DEBUG nova.compute.manager [None req-9b61e1a5-aeed-4fdf-98cd-2c6f0c193970 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72998) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 09:36:22 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:36:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 09:36:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 09:36:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72998) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 09:36:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:36:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72998) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 09:36:27 user nova-compute[72998]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72998) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}